-- Logs begin at Fri 2022-03-25 02:33:24 UTC, end at Fri 2022-03-25 03:49:55 UTC. -- Mar 25 03:10:02.753592 dv-cinder-835168-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 25 03:10:02.762911 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Mar 25 03:10:02 2022] *** Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: nodename: dv-cinder-835168-1-iscsi Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: machine: x86_64 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: clock source: unix Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: pcre jit disabled Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: detected number of CPU cores: 4 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: current working directory: / Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: detected binary path: /usr/bin/uwsgi-core Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: your processes number limit is 47680 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: your memory page size is 4096 bytes Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: detected max file descriptor number: 2048 Mar 25 03:10:02.764932 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: lock engine: pthread robust mutexes Mar 25 03:10:02.765871 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: thunder lock: enabled Mar 25 03:10:02.765871 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 25 03:10:02.765871 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 25 03:10:02.810436 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: Python main interpreter initialized at 0x561cfb1a99c0 Mar 25 03:10:02.810436 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: python threads support enabled Mar 25 03:10:02.810436 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: your server socket listen backlog is limited to 100 connections Mar 25 03:10:02.810436 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: your mercy for graceful operations on workers is 90 seconds Mar 25 03:10:02.810775 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: mapped 403077 bytes (393 KB) for 2 cores Mar 25 03:10:02.810855 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: *** Operational MODE: preforking *** Mar 25 03:10:02.811133 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: *** uWSGI is running in multiple interpreter mode *** Mar 25 03:10:02.811133 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: spawned uWSGI master process (pid: 79913) Mar 25 03:10:02.811318 dv-cinder-835168-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 25 03:10:02.812294 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: spawned uWSGI worker 1 (pid: 79919, cores: 1) Mar 25 03:10:02.812294 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: spawned uWSGI worker 2 (pid: 79920, cores: 1) Mar 25 03:10:02.812504 dv-cinder-835168-1-iscsi devstack@keystone.service[79913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 25 03:10:08.599003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 25 03:10:08.599003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: from cryptography.utils import int_from_bytes Mar 25 03:10:08.599798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 25 03:10:08.599798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: from cryptography.utils import int_from_bytes Mar 25 03:10:08.599910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 25 03:10:08.599910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: from cryptography.utils import int_from_bytes Mar 25 03:10:08.599910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 25 03:10:08.599910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: from cryptography.utils import int_from_bytes Mar 25 03:10:08.644476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 25 03:10:08.644661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 25 03:10:08.644756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 25 03:10:08.644877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] command line args: [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 25 03:10:08.644961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 25 03:10:08.645072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] command line args: [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 25 03:10:08.645153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 25 03:10:08.645305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ================================================================================ {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 25 03:10:08.645394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 25 03:10:08.645516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ================================================================================ {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 25 03:10:08.645599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] admin_token = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.645800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] admin_token = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.645879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] config_dir = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.645984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] config_dir = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] config_source = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] debug = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] config_source = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] debug = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.646980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.647960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_config_append = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_config_append = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_dir = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_file = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_dir = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_file = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.648951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.649932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.650935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.651950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] publish_errors = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] publish_errors = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.652975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] standard_threads = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.653982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] standard_threads = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] use_journal = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] use_json = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] use_journal = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] use_stderr = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.654961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] use_json = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] use_syslog = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] use_stderr = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] use_syslog = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.655478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 25 03:10:08.655628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.655705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.655882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.655965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.656932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.657915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.658857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.659980 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.660982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.661933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.662949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.663930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.664949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.665975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.666892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667809 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.667966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.668981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.669940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.670855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.671966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.672975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.673946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.674866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.675963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.676557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.676733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.676811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.676973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.677916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.678917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.679862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.external = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.external = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.680956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.password = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] auth.token = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.password = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.681934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] auth.token = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.682946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.683949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.684987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.685992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.686996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.687950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.688975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.689952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.690905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.691606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.692882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.693999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.694973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.695931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.696947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.697916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.698871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.699952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.700979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.701960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.702910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.703990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.704930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.705998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.706934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.707918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.708870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709579 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.709987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.710932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.711946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.712895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.713885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] role.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] role.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] role.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.714954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] role.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.715931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.716976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.717965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.718991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.719960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.720903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.721965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.722904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.723871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.724986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.725954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.726979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.connection = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.connection = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.727923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728473 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.728936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.729901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.730840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.731841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 25 03:10:08.731914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 25 03:10:08.732079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 25 03:10:08.762166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.762396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.762623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.763217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.763458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.763690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.771227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.772424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.799516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.799742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.800575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.800812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.854167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.855157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.903155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.903388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.904321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.904561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.974731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.974965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.975888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.976023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:08.976240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000272 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.000947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.001029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.001166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.001249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.001385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.001467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.012656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.012821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.025442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.025570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.025689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.025801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.025936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.026888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 25 03:10:09.052229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.052432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 25 03:10:09.052637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.052766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.052848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 25 03:10:09.052969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 25 03:10:09.053172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.053262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.053378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 25 03:10:09.053480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.053650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.053758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.053932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.054014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.054187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.054440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.064610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.064881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.065883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.073628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.074128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.076861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.077140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.077362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.077444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.077644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.077755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.077950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.078827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.079798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.080073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.106770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.107045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.108340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.108619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.108701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.108907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.114440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.114722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.114804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.115027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.115106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.115419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.122409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.122691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.122772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.122972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.127125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.127411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.127575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.127711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.127794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.127988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.128877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.129050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.129438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.129438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.147556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.147829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.147921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.148182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.152312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.152716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.155889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.156181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.156312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.156607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.161789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.162259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.165282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.165876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.168836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.169988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.170080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.170264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.170347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.170595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.170885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.189651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.189962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.190227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.190307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.190503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.190598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.190798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.191061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.198263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.198863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.199938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.200213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.200554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.200829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.203349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.203635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.203909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.203990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.204182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.204264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.204457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.204548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.204815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.205093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.217793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.218075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.218351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.218488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.218627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.218770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.218900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.219047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.219326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.219606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.219982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.220265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.220433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.220734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.238355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.238988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.241680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.242407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.244943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.245645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.247791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.249453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.249762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.250055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.258059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.259732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.263061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.263361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.349128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.350830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.351117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.351396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.358806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.360354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.364346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.364633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.364912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.365182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.365635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.365998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.374277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.374566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.374843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.375183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.375477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.375756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.383656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.383753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 25 03:10:09.383956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.384968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.385822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.386881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.387064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.387238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.387318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.387393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 25 03:10:09.425067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561cfb1a99c0 pid: 79920 (default app) Mar 25 03:10:09.425262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561cfb1a99c0 pid: 79919 (default app) Mar 25 03:10:09.429051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f897b-8c27-4e38-8b99-6b718f765cd8 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:09.429341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f897b-8c27-4e38-8b99-6b718f765cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:09.429616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f897b-8c27-4e38-8b99-6b718f765cd8 None None] PATH_INFO: `/v3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:09.433797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Fri Mar 25 03:10:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:18.669561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:18.670152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:18.670152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:18.675148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:18.680447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:18.680883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:18.680999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:18.711697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG oslo_db.sqlalchemy.engines [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 25 03:10:18.894122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG passlib.handlers.bcrypt [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79920) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 25 03:10:18.895081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG passlib.handlers.bcrypt [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79920) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 25 03:10:18.949483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:18.951074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:19.071975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 25 03:10:19.221095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:19.255108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG oslo_db.sqlalchemy.engines [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 25 03:10:19.380973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2af6c-2cb9-4350-bed6-4ee33d748d62 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:19.385191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:19.385874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:19.386161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:19.386440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:19.394870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:19.446266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 25 03:10:19.446617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53247e-2d94-463b-9d32-ca006f459dbc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:19.456051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Fri Mar 25 03:10:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 25 03:10:19.463738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:19.477901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d90ed-7b82-42fd-9792-d151dfd0c5aa None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:19.482161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:19.483251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:19.483537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:19.483811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] PATH_INFO: `/v3/projects/b1302222fc7241c1bba468ff84d0f185` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:19.485283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] RBAC: Authorizing `identity:get_project(project_id=b1302222fc7241c1bba468ff84d0f185)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:19.536706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.common.rbac_enforcer.enforcer [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 25 03:10:19.537050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853798eb-cd59-4f0c-ba99-d62f5e405e53 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:19.541626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Fri Mar 25 03:10:19 2022] GET /identity/v3/projects/b1302222fc7241c1bba468ff84d0f185 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:21.800362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa79af-b8a8-4479-a216-121bd87507ad None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:21.801425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa79af-b8a8-4479-a216-121bd87507ad None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:21.801528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa79af-b8a8-4479-a216-121bd87507ad None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:21.805993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:21.811284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:21.811672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:21.811832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:21.830180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:21.832017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:21.839743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 25 03:10:21.862179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa79af-b8a8-4479-a216-121bd87507ad None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:21.874674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa79af-b8a8-4479-a216-121bd87507ad None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:21.878822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:21.879445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:21.879729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:21.880003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:21.887614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:21.889398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec320a45-34ea-437b-bb5a-6b33a4e3e926 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:21.897987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Fri Mar 25 03:10:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 25 03:10:21.903210 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:21.912339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770853c-e6e8-4559-bbf0-85914e8d3021 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:21.916569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:21.917408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:21.917714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:21.917993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:21.919354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:21.921162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e89377-856c-45bb-9880-6fdffaac1b18 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:21.922710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Fri Mar 25 03:10:21 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:24.276247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a938-fa12-4145-9ec1-6a027a2773df None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.276731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a938-fa12-4145-9ec1-6a027a2773df None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.276731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a938-fa12-4145-9ec1-6a027a2773df None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.278500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:24.282444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228c7f6-9922-4294-9a44-07f69e138f8f None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.282855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228c7f6-9922-4294-9a44-07f69e138f8f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.283008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228c7f6-9922-4294-9a44-07f69e138f8f None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.283526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178436-821f-491c-8970-096124d7bdee None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.283819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178436-821f-491c-8970-096124d7bdee None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.284100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd178436-821f-491c-8970-096124d7bdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.285497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:24.290390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.290674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.290949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.308156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:24.309343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:24.325226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG passlib.handlers.bcrypt [None req-dd178436-821f-491c-8970-096124d7bdee None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79919) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 25 03:10:24.325647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG passlib.handlers.bcrypt [None req-dd178436-821f-491c-8970-096124d7bdee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79919) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 25 03:10:24.372770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dd178436-821f-491c-8970-096124d7bdee None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:24.374373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dd178436-821f-491c-8970-096124d7bdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:24.384727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 7/12] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:24.407279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.471150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 6/13] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:24.494432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd178436-821f-491c-8970-096124d7bdee None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.503288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273a8bc-427b-4dd1-8dc0-f3dff0f2fb07 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.535584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.536160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.536438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.536708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.588523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd178436-821f-491c-8970-096124d7bdee None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.599677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:24.601178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:24.620463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.621482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.621806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.622088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.633325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:24.640176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:24.641366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:24.647660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.694045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 8/15] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 25 03:10:24.699510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.746961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfeee3-6cad-4a1f-9271-4e043258d9d0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.779171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.779831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.780114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.780389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.781137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:24.781441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:24.782923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:24.789730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cc27-4dfc-46fa-8b49-f2b954e256c8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.794543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 8/16] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:24.799737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.821790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.822571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.822846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.823114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.833485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:24.834981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:24.850863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:10:24.852030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 9/17] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:24.857424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.893038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26df20b-af27-41c2-9559-7b2b1a62ecb9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.924906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.925837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.926120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.926397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.927946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:24.929432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:24.931079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 9/18] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:24.936301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:24.949300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc638c-c1c5-450c-b877-f3c304b38eaa None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:24.983034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:24.983679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:24.983962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:24.984243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:24.984984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:24.985286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:24.986731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:25.003275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 10/19] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:25.033648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5be09-82fb-4a02-aa4f-5ef5a2767ac5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:25.068589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:25.069309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:25.069591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:25.069891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:25.071099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:25.072572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d7c1-4503-4968-8a9e-783ce62d8eae None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:25.074229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 10/20] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:25.080240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:25.181431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1a1b6-fedf-425b-be0e-afb7cbf46d57 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:25.214713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:25.215377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:25.215648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:25.215918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:25.216730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.domain.id=default, user.id=e9bcc766764e43018f6a81968bc39446) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:25.217036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:25.218543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfc389-63ad-4b8c-aa6c-0f6565295593 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:25.225171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 11/21] 10.222.0.24 () {56 vars in 1322 bytes} [Fri Mar 25 03:10:25 2022] GET /identity/v3/role_assignments?user.id=e9bcc766764e43018f6a81968bc39446&scope.domain.id=default&role.id=36a26de00c7141a09176dacfb7236db0 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:27.861531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df989-ca2c-41e0-8f25-421c1793ec12 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:27.862577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df989-ca2c-41e0-8f25-421c1793ec12 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:27.863634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df989-ca2c-41e0-8f25-421c1793ec12 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:27.865637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 11/22] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:27.871152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d918a9-7976-4682-a445-773332aee7eb None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:27.872011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d918a9-7976-4682-a445-773332aee7eb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:27.872483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d918a9-7976-4682-a445-773332aee7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:27.906362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-32d918a9-7976-4682-a445-773332aee7eb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:27.907590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-32d918a9-7976-4682-a445-773332aee7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:27.954034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d6a4-6b9e-492d-8e9e-cbc567ea4882 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:27.954783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d6a4-6b9e-492d-8e9e-cbc567ea4882 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:27.955265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8d6a4-6b9e-492d-8e9e-cbc567ea4882 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:27.963356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 12/23] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:27.968278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:27.968799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:27.969276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:27.991828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 12/24] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:27.996305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:28.003633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:28.024016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d918a9-7976-4682-a445-773332aee7eb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.125123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 13/25] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:28.154732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.219620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d918a9-7976-4682-a445-773332aee7eb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.270241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d18a6-5f08-419e-a131-45a425f88e97 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.302356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.303031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.303309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.303575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.304316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:28.305334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.305738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c41a9-50aa-4f72-9517-261f9e72ce58 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:28.306154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.306438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.306716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.317628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:28.324533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3bc28802-55ee-476f-a642-8003358ce871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:28.325834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 14/26] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:28.329649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b99-cad0-4507-91c5-5df3151eceeb None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.329649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b99-cad0-4507-91c5-5df3151eceeb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.329649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b99-cad0-4507-91c5-5df3151eceeb None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.329649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 15/27] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:28.331141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4eb6-1899-49c8-8637-39c650fbc117 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.331463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4eb6-1899-49c8-8637-39c650fbc117 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.331742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4eb6-1899-49c8-8637-39c650fbc117 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.333505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 16/28] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:28.334326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d4eb6-1899-49c8-8637-39c650fbc117 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.439427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d4eb6-1899-49c8-8637-39c650fbc117 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.474596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.475268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.475553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.475891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.476627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:28.476933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:28.478352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4674e-2e5e-4eed-abe6-d69b0f3dad3f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:28.492239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 17/29] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:28.492239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.492239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.492239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.508787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:28.510157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:28.553188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 13/30] 10.222.0.24 () {60 vars in 1131 bytes} [Fri Mar 25 03:10:28 2022] POST /identity/v3/roles => generated 225 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:28.555150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.555645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.556139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.577361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:28.579362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:28.584143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 18/31] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:28.585940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.657138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 14/32] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:28.658415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.755340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afba13-33dd-4525-9d52-450808c53219 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.807766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.809329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.809861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.810499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.813044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:28.814819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:28.823264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 19/33] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:28 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:28.823264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.860792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79cdd-b28b-40a6-97f1-52db4f825eff None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.897158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.897966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.898252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.898534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.910133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:28.911767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:28.929709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:10:28.931945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 15/34] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:28.932831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:28.952810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a05d1-0e14-48bc-ade5-d356261f30a1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:28.992593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:28.993635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:28.995597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:28.995597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:28.995597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:28.996902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.049651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03d5a-f0f3-4385-b480-bc79938e5456 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.087766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.088552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.088838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.089112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.090376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.092025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.098562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 16/35] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:29.098562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.200284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff655f27-c4f7-4c3a-be2e-c5e1c1ab8734 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.225893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 20/36] 10.222.0.24 () {60 vars in 1131 bytes} [Fri Mar 25 03:10:28 2022] POST /identity/v3/roles => generated 219 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:29.226973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.244211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.245478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.246428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.246897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.248192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:29.248654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.251042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264f54-a3ce-4938-ade9-bd30cf5ec21a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.267546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 17/37] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:29.270401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0359ba-6618-421e-8d46-c01c0085730b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.270909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0359ba-6618-421e-8d46-c01c0085730b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.271401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0359ba-6618-421e-8d46-c01c0085730b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.273595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 18/38] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:29.274565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0359ba-6618-421e-8d46-c01c0085730b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.356721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eecff8-c093-4c1c-9e6c-986274e93dda None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.394830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.395675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0359ba-6618-421e-8d46-c01c0085730b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.396082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.396467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.396847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] PATH_INFO: `/v3/domains/default/users/e9bcc766764e43018f6a81968bc39446/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.399334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e9bcc766764e43018f6a81968bc39446, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.401066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8cd90-7c9d-4dba-883f-31bcd8a6e4cd None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.430538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.431759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.432041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.432314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.433023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.434529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6c160-d257-4b04-8b7a-b9627a1b1810 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.502607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 21/39] 10.222.0.24 () {58 vars in 1361 bytes} [Fri Mar 25 03:10:29 2022] PUT /identity/v3/domains/default/users/e9bcc766764e43018f6a81968bc39446/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:29.504496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.504788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.505065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.523386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:29.524976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:29.551671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 19/40] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:10:29 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:29.553287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b233ce5-4c9d-4141-9369-3a04eb747326 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.553763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b233ce5-4c9d-4141-9369-3a04eb747326 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.554379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b233ce5-4c9d-4141-9369-3a04eb747326 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.560939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 20/41] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:29.563010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.563546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.563979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.585108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:29.586880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:29.616432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 22/42] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:29.640024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.678291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 21/43] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:29.702812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.785436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f008bcb-f859-434e-b59b-ef620339d9cf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.824847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.825635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.825904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.826232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.826930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.828883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d72b-3371-443a-a1d1-50a07930d149 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:29.829015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c738-4731-4ffe-b6bd-1072ef604a8a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.863378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:29.864177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:29.864469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:29.864742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:29.865952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:29.867473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:29.869326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 22/44] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:29.874491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:29.909202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 23/45] 10.222.0.24 () {60 vars in 1131 bytes} [Fri Mar 25 03:10:29 2022] POST /identity/v3/roles => generated 223 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:10:29.980047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17c2b5-b343-4668-baee-55be18b2307b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:30.015492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:30.016295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:30.016623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:30.016851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:30.017564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:30.019134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d996a88-b797-4600-b9be-1122001d59c0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:30.127170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:10:29 2022] POST /identity/v3/projects => generated 312 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:10:31.818027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a637-acad-4605-aaa0-d35443156491 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:31.818591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a637-acad-4605-aaa0-d35443156491 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:31.818591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a637-acad-4605-aaa0-d35443156491 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:31.820360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 24/47] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:31.825568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:31.825997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:31.826161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:31.844026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:31.845202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:31.907401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 24/48] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:31.930580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a637-acad-4605-aaa0-d35443156491 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.031428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a637-acad-4605-aaa0-d35443156491 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.066326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.067122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.067409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.067687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.078021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:32.085079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:32.086294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 25/49] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:32.091956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.184576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742cfc-9a1e-4d7a-a1c3-90d231a15594 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.216063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.216727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.217012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.217291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.218057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:32.218363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.219777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.231337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 25/50] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:32.236897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.331079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5651-b6db-4aec-8567-4ca6265a0503 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.362841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.363690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.363977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.364254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.365439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.366943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ec8f-0e2d-4c92-b386-9da23022bcba None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.368560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 26/51] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:32 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:32.373913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.383006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be07d8-0bce-46fc-a268-8d29328ec6b6 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.383296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be07d8-0bce-46fc-a268-8d29328ec6b6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.383574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be07d8-0bce-46fc-a268-8d29328ec6b6 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.385279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 27/52] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:32.390038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.390328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.390608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.407313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:32.408491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:32.469530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2686e1-c889-42f7-ba2a-d56f877f0f3b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.471645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 28/53] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:32.493979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.500631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.501426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.501743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.502024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.503724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.505188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.506834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 26/54] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:32.512254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.586522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084833d-7845-469f-bc7e-72f57bc982d6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.605650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238cbd-7f35-4996-afc4-fb16053074c6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.618226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.619006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.619293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.619569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.620729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.622228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.623814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 29/55] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:32.629284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:32.636627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.637274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.637560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.637917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.638705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.domain.id=default, user.id=e9bcc766764e43018f6a81968bc39446) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:32.639017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.640470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985f22-4ee7-4de8-adf8-b27591f2481a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.646567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 27/56] 10.222.0.24 () {56 vars in 1322 bytes} [Fri Mar 25 03:10:32 2022] GET /identity/v3/role_assignments?user.id=e9bcc766764e43018f6a81968bc39446&scope.domain.id=default&role.id=36a26de00c7141a09176dacfb7236db0 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:32.728581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9ed2e-0a23-4258-8d8f-8505727dcb95 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:32.763367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:32.764048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:32.764335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:32.764613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:32.765329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:32.766850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42419d-82fc-4fa3-9f11-88bacde17319 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:32.864641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 30/57] 10.222.0.24 () {60 vars in 1140 bytes} [Fri Mar 25 03:10:32 2022] POST /identity/v3/projects => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:10:35.135134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0850-bcf6-4b5d-94f8-a480954851b1 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:35.135662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0850-bcf6-4b5d-94f8-a480954851b1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:35.135878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0850-bcf6-4b5d-94f8-a480954851b1 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:35.137572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 28/58] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:35.142749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:35.143120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:35.143317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:35.159829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:35.161000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:35.223972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 31/59] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:35.248026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0850-bcf6-4b5d-94f8-a480954851b1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:35.345169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0850-bcf6-4b5d-94f8-a480954851b1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:35.375899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:35.376676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:35.376962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:35.377241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:35.378956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:35.380432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319afad-a8b2-40d1-b37b-a8301b5173cc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:35.382096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 29/60] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:35.387258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:35.481217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143562e8-a5cd-4c02-9903-43ef9f9cc344 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:35.513142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:35.513829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:35.514123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:35.514407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:35.515122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:35.516588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250afd-537d-423f-bab4-8a1147531602 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:35.627842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 32/61] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:10:35 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:39.150186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b48aa-7c36-413d-ac1f-4c27c973a682 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.151216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b48aa-7c36-413d-ac1f-4c27c973a682 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.151834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b48aa-7c36-413d-ac1f-4c27c973a682 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.153936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 30/62] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:39.159811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cd6bf-d9b1-4ece-9d0c-31c74d5b70cd None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.160215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cd6bf-d9b1-4ece-9d0c-31c74d5b70cd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.160379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cd6bf-d9b1-4ece-9d0c-31c74d5b70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.183860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-585cd6bf-d9b1-4ece-9d0c-31c74d5b70cd None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:39.185059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-585cd6bf-d9b1-4ece-9d0c-31c74d5b70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:39.196240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181ea8-ac65-43d3-83be-ac2d382f7d27 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.196826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181ea8-ac65-43d3-83be-ac2d382f7d27 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.197302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181ea8-ac65-43d3-83be-ac2d382f7d27 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.199587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:39.211170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.211723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.212216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.238857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:39.240330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:39.264729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 33/64] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:39.274662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c055-b14c-40a8-85ee-906d6cd0f11f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.275147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c055-b14c-40a8-85ee-906d6cd0f11f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.275604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4c055-b14c-40a8-85ee-906d6cd0f11f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.281230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 34/65] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:39.282855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.283321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.283769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.301927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:39.303405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:39.322062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 32/66] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:39.323004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.375296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 35/67] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:39.382808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.428943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b93ead-98af-4e94-aaed-cb8faa04ba08 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.463678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.464491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.464784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.465061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.477478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:39.484896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:10:39.486631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 33/68] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:39.487565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.493239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee0bf-63e0-40f4-9af2-d4f7af5d4cca None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.527788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.528594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.528880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.529153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.540924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:39.548084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:39.553980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 36/69] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:39.553980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.587103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590307-b5e8-4cfd-94cc-c4054dc85352 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.621712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.621712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.621712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.622035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.633312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:39.640247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-6ec4eb1a-7233-48a9-b4dd-be420f081360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:39.641614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 34/70] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:39.642855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be532f7-32a7-4294-9d7e-b3fdcf250df3 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.643143 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be532f7-32a7-4294-9d7e-b3fdcf250df3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.644096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be532f7-32a7-4294-9d7e-b3fdcf250df3 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.645777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 35/71] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:39.646753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be532f7-32a7-4294-9d7e-b3fdcf250df3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.657147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8a67-31c1-466d-93b6-2b3145528a61 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.690695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.691363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.691650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.691934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.692707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:39.693017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:39.694446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:39.706703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:39.708770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.748647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be532f7-32a7-4294-9d7e-b3fdcf250df3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.781060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.781767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.782057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.782334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.783070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:39.783398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:39.784836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e015d1-e42b-4cb7-b57b-ef19d3e65b80 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:39.792628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:39.793808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2677-0764-49b7-9b99-f7b677196b2e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.794252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2677-0764-49b7-9b99-f7b677196b2e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.794698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2677-0764-49b7-9b99-f7b677196b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.803738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e30d-5351-4685-8e1a-7bec2135fe9c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.810540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f9ec2677-0764-49b7-9b99-f7b677196b2e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:39.811750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f9ec2677-0764-49b7-9b99-f7b677196b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:39.836401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.837054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.837338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.837618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.838372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:39.838675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:39.840058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:39.847687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:39.848458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.875311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 37/75] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:39.885861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cee15-e7f0-4460-b6b9-ae4b9f90d551 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.885861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cee15-e7f0-4460-b6b9-ae4b9f90d551 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.885861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cee15-e7f0-4460-b6b9-ae4b9f90d551 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.885861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 38/76] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:39.885861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cee15-e7f0-4460-b6b9-ae4b9f90d551 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:39.943406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f44-2095-476c-bb4e-b979cff52286 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.976836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:39.977738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:39.978029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:39.978320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:39.979942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cee15-e7f0-4460-b6b9-ae4b9f90d551 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:39.993258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:39.994758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:39.996413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 39/77] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:39.997177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.013292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.014135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.014420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.014697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.015893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.017364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a58c6-d51e-4dc8-b3fb-943320a248c7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.019644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 39/78] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.020830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.021124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.021407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.037075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:40.038270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:40.092314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2849c-5dd2-4849-abfc-0d08cd5beb68 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.100682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 40/79] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:40.101499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.125433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.126323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.126635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.126910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.128698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.130177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.131775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 40/80] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:39 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.132521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.199825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15919545-ce57-4f63-8e0f-c72ed9700f44 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.226426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc484-dc00-45d7-b83f-ce4b3cbadd8a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.231232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.232017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.232301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.232578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.242793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:40.249611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:40.250799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 41/81] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:40.251561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.259440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.260082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.260375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.260653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.323098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.324485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.344693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449263-164a-4a2a-8fb5-d265f34c5eb5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.376243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.376876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.377166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.377450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.415700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 41/82] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:40.416313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.441916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.443403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.513243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee37e-a92e-4574-9c42-a46e29ef1580 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.533755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 42/83] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:40.535097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.545687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.546512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.546799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.547077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.548243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.550322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.551970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 42/84] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.552736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.628646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529c25f-d47e-4001-96bd-5007119042b7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.645499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8689e-3842-42db-9b41-ec9508191f02 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.660578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.661212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.661491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.661802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.677767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.678420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.678702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.678977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.679701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:40.680004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.681388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.689067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 43/85] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.689866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.725971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.727458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.782115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381de6bd-7802-4927-a743-83229f310a41 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.813576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.814432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.814715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.814988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.816186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.817601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.819279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 44/86] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.819928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:40.820042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.820583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:40.912484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19203e10-abd6-4202-9306-ac94b2622b1c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.914312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2e-9ac5-4a73-8a13-365edab4811f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:40.943172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.944101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.944386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.944660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.945832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.945928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:40.946538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:40.946823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:40.947102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:40.947262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.947826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:40.948921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 45/88] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:40.949287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:40.949684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.027878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 44/89] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:10:40 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:41.028710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.045929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de6dc-ba2e-4a16-b408-f5527d338e80 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.082105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.083002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.083291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.083568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.084877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.086449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.092709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 46/90] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:40 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.092709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.139765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e366-211d-4df9-ae70-0a6460dec458 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.174972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.175803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.176113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.176358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.177583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.179111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.181011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 45/91] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.181647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.197931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22f6a-ed10-459a-b74f-e003e706878c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.238271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.239532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.239532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.239532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.240387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:41.241318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.242076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.250086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 47/92] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.253715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.296664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972dbd-04cb-4168-ba3a-7f5913b2ed4d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.334616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.335292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.335578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.335856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.336694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:41.337004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.338560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.344876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 46/93] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.346954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.365514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccd11-41a3-4732-9b19-ea3d429057dc None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.412468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.413147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.413440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.413772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.465202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef643a-c26c-41ad-bff5-de93c889767f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.496859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.498455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.511750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.512744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.512956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.513245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.514175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=e9bcc766764e43018f6a81968bc39446) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:41.514548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.516061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.523463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 47/94] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/role_assignments?user.id=e9bcc766764e43018f6a81968bc39446&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.618751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 48/95] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:41.624351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:41.852398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54812d-d3d3-4fd1-9aa7-c3b87a9436c6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:41.917206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:41.918742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:41.919252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:41.919745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] PATH_INFO: `/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:41.921847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] RBAC: Authorizing `identity:get_project(project_id=d6dab7ec164f4a41818a02f3f8e9cb9f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:41.924680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23045a-9ecb-45b5-86ff-d41010ebd98a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:41.927757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 48/96] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f => generated 312 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:41.937011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:42.112708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c4d3b-2e23-4200-a7cc-c4938747bc6e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:42.172739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:42.173876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:42.174531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:42.175513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:42.177112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=d6dab7ec164f4a41818a02f3f8e9cb9f, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:42.177693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:42.180584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44c303-6ca9-44f1-972a-d3cd2d921f32 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:42.190861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 49/97] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:41 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=d6dab7ec164f4a41818a02f3f8e9cb9f&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:44.559417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb531-f398-4521-8094-a199079a61ba None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:44.559994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb531-f398-4521-8094-a199079a61ba None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:44.560263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb531-f398-4521-8094-a199079a61ba None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:44.562340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 49/98] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:44.572519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:44.573403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:44.573921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:44.597162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:44.598786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:44.690732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 50/99] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:44.734124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bb531-f398-4521-8094-a199079a61ba None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:44.863377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bb531-f398-4521-8094-a199079a61ba None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:44.911552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:44.912374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:44.912656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:44.912933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:44.914235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:44.915752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569949fe-4891-43d4-b167-a640a25c11d3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:44.917461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 50/100] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:44.923484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.004119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39119-fff6-4c50-9944-4a1c5b2441d3 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.004499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39119-fff6-4c50-9944-4a1c5b2441d3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.004690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39119-fff6-4c50-9944-4a1c5b2441d3 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.006468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 51/101] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:45.019939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.020225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.020507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.045354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:45.048845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:45.057107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58fab-5587-46a7-8192-767c5f087c23 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.134537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.135129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.135414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.135689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.136409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:45.137906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74921b25-64c0-442a-b361-f49ad98f4fa9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:45.179649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 52/102] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:45.213518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.245795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 51/103] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:10:44 2022] POST /identity/v3/projects => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:45.332752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150d364-a469-4f41-ae0d-9e91e2e77ab9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.367991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.368790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.369068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.369341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.381028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d00-6a04-40dc-9ea1-d5e7219e9db0 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.381350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d00-6a04-40dc-9ea1-d5e7219e9db0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.381594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d00-6a04-40dc-9ea1-d5e7219e9db0 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.382145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:45.383404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 52/104] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:45.388837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.389057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.389337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.389788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:45.391031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 53/105] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:45.396531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.410413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:45.411684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:45.499532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecc85a-1c3a-4e91-bbfa-612487d476de None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.524538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 53/106] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:45.535471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.536153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.536434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.536704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.537465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:45.537804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:45.539224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297b8cc-f400-4cff-ac60-0aaf606a299f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:45.548156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 54/107] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:45.554403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.560452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064d6f-77d5-42ab-ae94-2ea21a1cdd54 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.560957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064d6f-77d5-42ab-ae94-2ea21a1cdd54 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.561055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064d6f-77d5-42ab-ae94-2ea21a1cdd54 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.563155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 55/108] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:45.572325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064d6f-77d5-42ab-ae94-2ea21a1cdd54 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.669211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865676-71d0-4c0c-9a78-4bd9a438f4f2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.677788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064d6f-77d5-42ab-ae94-2ea21a1cdd54 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.712635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.713514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.713841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.721140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.721266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.721266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.721417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:45.721520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.721520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.721657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa1540-9803-462d-9a66-4c9d9bd35aa0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:45.721657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 54/109] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:45.721657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5350-1d1b-4b8a-bcbe-f3f4eddba86c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.721657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5350-1d1b-4b8a-bcbe-f3f4eddba86c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.721657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5350-1d1b-4b8a-bcbe-f3f4eddba86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.727276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:45.734274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3fa5b1e4-f62f-4542-9392-01785d471a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:45.735673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 56/110] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:45.736834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df370d9-5d38-4ee4-b69f-98234954c623 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.737161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df370d9-5d38-4ee4-b69f-98234954c623 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.737398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df370d9-5d38-4ee4-b69f-98234954c623 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.739254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 57/111] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:45.739816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df370d9-5d38-4ee4-b69f-98234954c623 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.742694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-beea5350-1d1b-4b8a-bcbe-f3f4eddba86c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:45.743887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-beea5350-1d1b-4b8a-bcbe-f3f4eddba86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:45.814430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 55/112] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:45.815832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f923f-533c-477c-8b03-3afee5de255c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.816130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f923f-533c-477c-8b03-3afee5de255c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.816412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f923f-533c-477c-8b03-3afee5de255c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.822204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 56/113] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:45.822204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f923f-533c-477c-8b03-3afee5de255c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:45.848746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df370d9-5d38-4ee4-b69f-98234954c623 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.882765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.883912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.884199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.884474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.885681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:45.887176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82208878-d1fb-4b4e-890e-a2c51ae9b447 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:45.888867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 58/114] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:45.890043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53e6-29b7-40fc-bd6c-0137c1d50d89 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.890330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53e6-29b7-40fc-bd6c-0137c1d50d89 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.890608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef53e6-29b7-40fc-bd6c-0137c1d50d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.906617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b9ef53e6-29b7-40fc-bd6c-0137c1d50d89 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:45.907812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b9ef53e6-29b7-40fc-bd6c-0137c1d50d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:45.941568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f923f-533c-477c-8b03-3afee5de255c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:45.977066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 59/115] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:45.978559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.978918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.979263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.989396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:45.990591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:45.991897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:45.992369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:45.993467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:45.994081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:45.995744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.001822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:46.003406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:46.007091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 57/116] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.007091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.085686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 60/117] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:46.085686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.104808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573fed-2418-40a6-bf4c-0620f759255c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.136932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.137791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.138110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.138393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.149877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:46.157097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:10:46.158326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 58/118] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:46.159644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.186458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf977f-ab6b-4164-9610-4982e0c6fdcd None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.224334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.225559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.226114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.227022 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/961c71cb778245dc92e8ea1976208eb1/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.229029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, user_id=961c71cb778245dc92e8ea1976208eb1, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.230534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.260141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1fda9-577e-4988-a930-267c7e3ab515 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.291432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.292217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.292506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.292780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.303391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:46.307782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 61/119] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:46 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/961c71cb778245dc92e8ea1976208eb1/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:46.311332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:46.318348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 59/120] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:46.318348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.318987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.435539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0485d1-e97f-4c4e-b875-4f41f88fbf73 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.435978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f554-d4eb-4b46-86d8-12a80f03cbe2 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.474039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.474248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.475134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.475366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.475646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.476061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.476539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.476920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.477233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.478455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.480390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 62/121] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.480999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.490870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:46.498278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:10:46.499871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 60/122] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:46.500850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.598009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46f21-52b4-42ba-9cf0-d2b50f24e35d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.610103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0f18c-98df-45f1-916f-44ed176476be None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.633432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.634140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.634427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.634704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.635452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:46.635759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.637168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.644728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.645421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.645759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.646048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.646852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:46.647037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 63/123] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.647194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.647954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.648673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.657518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 61/124] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.658450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.752229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857400-a92d-4bef-bc5a-70dbdf991355 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.761754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52a807-0542-4e95-8fac-a1d327671ae4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.785770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.786635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.786921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.787199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.788388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.789901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.791597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 64/125] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.792435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.796278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.796811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.797101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.797383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.798227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:46.798542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.804171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.812727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 62/126] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.813545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.895475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578534-2893-4aac-ad7e-cb52a0dd31b9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.913157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f930-331f-4cc9-baa9-f0553172bf95 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:46.929684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.930613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.930901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.931230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.932437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.933933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.935716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 65/127] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.936367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:46.946791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:46.947660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:46.947949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:46.948228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:46.949449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:46.951159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:46.952709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 63/128] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:46.953466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.035932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69813-64ca-497b-883d-e90c055bc35d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.060630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a61-d252-44ac-875f-f48688cf48f0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.070131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.071027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.071313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.071591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/e9bcc766764e43018f6a81968bc39446/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.073860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, user_id=e9bcc766764e43018f6a81968bc39446, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.075854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.095461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.096381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.096673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.101265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] PATH_INFO: `/v3/users/b736d2bf1e004838b3d2c517d1b682a8` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.110881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] RBAC: Authorizing `identity:get_user(user_id=b736d2bf1e004838b3d2c517d1b682a8)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.112896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.114806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 64/129] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:46 2022] GET /identity/v3/users/b736d2bf1e004838b3d2c517d1b682a8 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:47.115504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.187567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 66/130] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:46 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/e9bcc766764e43018f6a81968bc39446/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:47.194009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.253407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14e99-414f-49be-bbfb-6bb8a52e5c6e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.314362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.316192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.316664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.318999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.325633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.327210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.329246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 65/131] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:47 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:47.330491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.402777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6e33-985d-4fb3-8976-9a3af882c975 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.447166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.448038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.448325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.448639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] PATH_INFO: `/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.450301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] RBAC: Authorizing `identity:get_project(project_id=d6dab7ec164f4a41818a02f3f8e9cb9f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.452147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.454536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 67/132] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:47 2022] GET /identity/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:47.457525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.476100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eb253-8c75-4d3d-ab44-ca2915a67c49 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.514265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.515304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.515805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.516301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.578996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd9a03-328d-4b89-9631-e88467cfa2bd None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.610701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.612796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.615431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.616335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.616620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.616897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/961c71cb778245dc92e8ea1976208eb1/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.619208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, user_id=961c71cb778245dc92e8ea1976208eb1, role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.620691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.708365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 68/133] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:47 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/961c71cb778245dc92e8ea1976208eb1/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:47.708977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.717390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 66/134] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:47.723235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.827347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc50-9a50-4801-b51c-170fd8f0bff8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.873381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162e33-f1b0-40e6-b2c7-3e4a66f16416 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:47.886452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.887343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.887632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.887910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.889245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.893468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:47.893468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 67/135] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:47 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:47.899673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:47.934777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:47.935837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:47.936221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:47.936602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] PATH_INFO: `/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f/users/961c71cb778245dc92e8ea1976208eb1/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:47.941538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6dab7ec164f4a41818a02f3f8e9cb9f, user_id=961c71cb778245dc92e8ea1976208eb1, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:47.943219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2826a-cb64-4897-97b9-b9d10089cc95 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:48.022879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 69/136] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:47 2022] PUT /identity/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f/users/961c71cb778245dc92e8ea1976208eb1/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:48.026037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da3e-9560-45b1-9993-d0455b040c6c None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:48.026488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da3e-9560-45b1-9993-d0455b040c6c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:48.026914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da3e-9560-45b1-9993-d0455b040c6c None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:48.028871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 70/137] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:48.036191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:48.036510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:48.036894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:48.065908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:48.067264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:48.073375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2b8c-ba55-46d8-9c6e-039b3e5e185a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:48.140068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:48.140671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:48.140950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:48.141221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:48.142092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=b736d2bf1e004838b3d2c517d1b682a8) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:48.142403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:48.144543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:48.152542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 68/138] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:47 2022] GET /identity/v3/role_assignments?user.id=b736d2bf1e004838b3d2c517d1b682a8&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=0308043db0c54638b0db187894b87790 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:48.162424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 71/139] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:48.190471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:48.300543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e401-f328-4662-9d11-927ed7d60904 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:48.337546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:48.338520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:48.338905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:48.339307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:48.340608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:48.342206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e39028-ccfd-40a5-bd06-9d1d005f603c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:48.343953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 69/140] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:48.349813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:48.461221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83478eac-e5b9-40dd-a92d-1c5f3c138626 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:48.498844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:48.499694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:48.500105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:48.500476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:48.501304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:48.503588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a423a-5b62-49e7-8fbd-c5e65307c185 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:48.640142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 72/141] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:10:48 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:49.280854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a722d9-1ec3-486c-948b-3de31b69201e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:49.281339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a722d9-1ec3-486c-948b-3de31b69201e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:49.281339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a722d9-1ec3-486c-948b-3de31b69201e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:49.283278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 70/142] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:49.288721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:49.289263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:49.289763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:49.308351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:49.309859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:49.396205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 73/143] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:49.433160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a722d9-1ec3-486c-948b-3de31b69201e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:49.565036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a722d9-1ec3-486c-948b-3de31b69201e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:49.602685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:49.603481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:49.603763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:49.604039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:49.618147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:49.625000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:49.626578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 71/144] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:49.632144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:49.778089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660cabb-d571-4b79-afd1-1af14d7e5362 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:49.829436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:49.830109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:49.831507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:49.831507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:49.832005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:49.832317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:49.833758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:49.848106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 74/145] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:49.853958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:49.987839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffacab9-d505-4de9-ab36-cdf70d325046 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.026864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.027744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.028029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.028306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.029501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.030972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe03f-50d9-4fd1-82e6-e904e9bdfc57 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.032876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 72/146] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:49 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:50.038760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.195964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6841-f107-4c50-8a72-afc6ece6f9b7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.241065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.241753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.242042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.242317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.253989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee014-e21c-4887-bbd0-ca574964d64d None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.254572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee014-e21c-4887-bbd0-ca574964d64d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.255091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee014-e21c-4887-bbd0-ca574964d64d None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.257050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 73/147] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:50.262956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.263500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.263988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.282128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:50.285172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:50.358916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 74/148] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:50.382750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.384252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.386474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.500464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb733-2ed2-4b09-8c66-bc9b7568096a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.538400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.539631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.540114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.540620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.553904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:50.562560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:50.564031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 75/149] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:50.569907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.608509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 75/150] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:50.614171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.678646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4a14d-65b2-4431-8ae9-b5828c08df3d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.713554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.714618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.715186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.715665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.716646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:50.717142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.718766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.727705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 76/151] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:50.733269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.741298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc911a-6853-49f3-b302-7ffa53759bf0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.775876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.776662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.776943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.777217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.778602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.779905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.781952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 76/152] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:50.787717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.842094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903038-8cae-4fa6-8377-32300cfae69f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.879083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.880189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.880612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.881024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] PATH_INFO: `/v3/users/e9bcc766764e43018f6a81968bc39446` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.882411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] RBAC: Authorizing `identity:get_user(user_id=e9bcc766764e43018f6a81968bc39446)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.884064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.885864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 77/153] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/users/e9bcc766764e43018f6a81968bc39446 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:50.891356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:50.910809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47b31a-569f-4617-8fe1-d5945ff60b9e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:50.953851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:50.956217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:50.956634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:50.957033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:50.958028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:50.958495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:50.961401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:50.968120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 77/154] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:51.008449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b199-9aac-4ca4-a55c-b4969732925e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:51.046836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:51.047820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:51.048302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:51.048788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:51.123682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:51.125582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:51.241554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 78/155] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 25 03:10:51.247158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:51.371544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69304413-499a-41d9-a5f7-3387fce5ff91 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:51.414921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:51.415789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:51.416070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:51.416356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:51.417560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:51.419266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d226db-ac0a-47a9-9445-fe2e61931b2a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:51.421144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 78/156] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:51 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:51.427431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:51.572174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6033f-0d7b-46c3-b13f-218f5d339705 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:51.612909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:51.613976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:51.614483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:51.614946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:51.615961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=e9bcc766764e43018f6a81968bc39446) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:51.616464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:51.618172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab237ef5-a0ff-42f5-a536-b76984a305a2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:51.628748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 79/157] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:51 2022] GET /identity/v3/role_assignments?user.id=e9bcc766764e43018f6a81968bc39446&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:51.929328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cb92-3fba-4b24-8d9c-85c76c63ac78 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:51.929854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cb92-3fba-4b24-8d9c-85c76c63ac78 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:51.929854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cb92-3fba-4b24-8d9c-85c76c63ac78 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:51.931788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 79/158] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:51.937153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d8b1-5e34-4869-826c-0c46e811700c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:51.937791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d8b1-5e34-4869-826c-0c46e811700c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:51.938292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d8b1-5e34-4869-826c-0c46e811700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:51.967339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a811d8b1-5e34-4869-826c-0c46e811700c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:51.968843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a811d8b1-5e34-4869-826c-0c46e811700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:52.058150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 80/159] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:52.089800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4cb92-3fba-4b24-8d9c-85c76c63ac78 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.224339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4cb92-3fba-4b24-8d9c-85c76c63ac78 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:52.240781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766beb1-c6f6-4201-990c-a63ce9941f5f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.241060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766beb1-c6f6-4201-990c-a63ce9941f5f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.241378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766beb1-c6f6-4201-990c-a63ce9941f5f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.243772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 81/160] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:52.249260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.249524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.249846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.262461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:52.263261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.264380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.264380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.268710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:52.270135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:52.278621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:52.285520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-34241e78-5c3e-4b93-b09c-27facce87e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:52.286934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 80/161] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:52.288350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4e66-d7a7-4628-832c-87c8a46c865b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.288648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4e66-d7a7-4628-832c-87c8a46c865b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.288904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4e66-d7a7-4628-832c-87c8a46c865b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.291114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 81/162] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:52.299589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.299866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.300146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.321246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:52.322520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:52.352886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 82/163] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:52.353871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.433037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 82/164] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:52.434017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.526520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96cce4-c87c-41af-ac88-ae8c5394d08c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:52.594219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:52.594941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.595220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.595486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.596773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:52.597072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:52.598515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:52.607395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4590a-32e4-4ba4-9ca4-badc9b98631e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:52.618851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 83/165] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:52.621560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.666524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:52.667329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.667604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.667929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.684095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:52.692410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:10:52.699352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 83/166] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:52.700223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.809809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f61c4-1504-4103-b3a7-ba4588b242e5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:52.817774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcfb37-7947-43fc-b89e-3444d015d965 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:52.854020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:52.854894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.855174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.855441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.857609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:52.859169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:52.860808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 84/167] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:52.869611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.894362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:52.895164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:52.895442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:52.895709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:52.922530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:52.929454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:10:52.938938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 84/168] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:52.939616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:52.979721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85661c-866a-4617-bc96-94af998b25dc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.020797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.021475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.021783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.022059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.022808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:53.023111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.025277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.042876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 85/169] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.047878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.148972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e485-70a9-4265-83b3-530fb5a5bd11 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.152048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b2d7-7268-4ccf-9025-cdd4b793e962 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.193217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.193952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.194236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.194512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.194738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.195467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:53.195779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.196004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.196481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.196942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.197226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.207038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 86/170] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.207839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.274070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.275892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.375206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 85/171] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:53.376380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.387784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41783483-45fc-45c5-b169-934c41ce7930 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.475032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.475842 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.476126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.476429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] PATH_INFO: `/v3/users/961c71cb778245dc92e8ea1976208eb1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.481384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c766-59a2-4f3e-aca1-c8d12aca3be5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.482581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] RBAC: Authorizing `identity:get_user(user_id=961c71cb778245dc92e8ea1976208eb1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.484136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.486142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 87/172] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/users/961c71cb778245dc92e8ea1976208eb1 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.486952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.528175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.529740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.530197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.530642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] PATH_INFO: `/v3/users/b736d2bf1e004838b3d2c517d1b682a8` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.534431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] RBAC: Authorizing `identity:get_user(user_id=b736d2bf1e004838b3d2c517d1b682a8)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.536045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.537839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 86/173] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/users/b736d2bf1e004838b3d2c517d1b682a8 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.538738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.646498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1774-9327-4567-b102-1c2340bd224c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.677400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0c96e-998e-4421-874b-4843555d324e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.680845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.681490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.681801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.682073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.728522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.729304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.729583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.729890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] PATH_INFO: `/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.734942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] RBAC: Authorizing `identity:get_project(project_id=d6dab7ec164f4a41818a02f3f8e9cb9f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.737155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.741658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 88/174] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/projects/d6dab7ec164f4a41818a02f3f8e9cb9f => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.742873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.771247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.772773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb6502-e6b2-4c46-9bb1-ba34909eb5d1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.867006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ccaa9-9b0e-4aef-8799-ae17fbd0c207 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:53.875098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 87/175] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:53.878944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d35fe-b893-4168-93ea-4f6dd67a76eb None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.878944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d35fe-b893-4168-93ea-4f6dd67a76eb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.878944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d35fe-b893-4168-93ea-4f6dd67a76eb None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.878944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 88/176] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:53.879403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d35fe-b893-4168-93ea-4f6dd67a76eb None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.913768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:53.915118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.916310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.916808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.918217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:53.919892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f337f-e537-45f4-98c4-ec2cfeb13772 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:53.922586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 89/177] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:53.924781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bc8e-890a-46ac-82f4-7b9dfb9ad3fb None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:53.925321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bc8e-890a-46ac-82f4-7b9dfb9ad3fb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:53.925820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bc8e-890a-46ac-82f4-7b9dfb9ad3fb None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:53.928498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 90/178] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:53.929599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bc8e-890a-46ac-82f4-7b9dfb9ad3fb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:53.984209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d35fe-b893-4168-93ea-4f6dd67a76eb None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.016389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.017026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.017300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.017577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.018978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=d6dab7ec164f4a41818a02f3f8e9cb9f, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:54.019282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.020731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada1670-e306-4341-9c6e-ce5c4ec4fe88 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.026215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 89/179] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=d6dab7ec164f4a41818a02f3f8e9cb9f&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.027349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf13753-b47d-4cac-8883-2af6231d6207 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.027628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf13753-b47d-4cac-8883-2af6231d6207 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.027896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf13753-b47d-4cac-8883-2af6231d6207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.036532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bc8e-890a-46ac-82f4-7b9dfb9ad3fb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.044961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-adf13753-b47d-4cac-8883-2af6231d6207 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:54.046241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-adf13753-b47d-4cac-8883-2af6231d6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:54.073146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.074054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.074335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.074610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.075811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.077309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.079081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 91/180] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:53 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.079871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.120527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 90/181] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:54.121612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec676-42cf-4d10-8ab7-cbdce189f5a8 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.121933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec676-42cf-4d10-8ab7-cbdce189f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.122210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec676-42cf-4d10-8ab7-cbdce189f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.142421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-441ec676-42cf-4d10-8ab7-cbdce189f5a8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:54.144552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-441ec676-42cf-4d10-8ab7-cbdce189f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:54.202361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a4fd3-e58f-4c67-a9a2-a1002c4cccca None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.218360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 91/182] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:54.219683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd890-7c2d-4bc2-afa9-8141b0ac2b43 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.219966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd890-7c2d-4bc2-afa9-8141b0ac2b43 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.220240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd890-7c2d-4bc2-afa9-8141b0ac2b43 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.222342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 92/183] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:54.223053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd890-7c2d-4bc2-afa9-8141b0ac2b43 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.249848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.250196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.250479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.250804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/b736d2bf1e004838b3d2c517d1b682a8/roles/0308043db0c54638b0db187894b87790` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.253350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, user_id=b736d2bf1e004838b3d2c517d1b682a8, role_id=0308043db0c54638b0db187894b87790)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.255085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.325485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd890-7c2d-4bc2-afa9-8141b0ac2b43 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.341908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 92/184] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:54 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/users/b736d2bf1e004838b3d2c517d1b682a8/roles/0308043db0c54638b0db187894b87790 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:10:54.353611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.358817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.359487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.359765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.360102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.360961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=961c71cb778245dc92e8ea1976208eb1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:54.361270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.363302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c6c5b-212d-4fbd-8a51-9bf92d2d7a4c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.369651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 93/185] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/role_assignments?user.id=961c71cb778245dc92e8ea1976208eb1&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.370980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.371264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.371537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.389321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:54.390600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:54.477771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 94/186] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:54.479092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.492577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b958-1eeb-4ca4-b661-5019f9aa22b9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.548597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.549962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.550242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.550515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.563247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:54.571246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:54.572802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 93/187] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:54.573604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.595739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f68c85-992b-4e4d-9e7e-227de843dfb6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.636106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.637218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.637696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.638140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.641086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.643409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.645197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 95/188] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.646055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.695477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749618-bfa9-4b2e-85b0-714c1ee52ce0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.728661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.729444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.729978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.730097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.740350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:54.747557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:10:54.753284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 94/189] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:54.753284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.755513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb4c8-94d0-4923-bde1-f7f108a10dbf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.791350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.792015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.792296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.792569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.793305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:54.793609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.795035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.803223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 96/190] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.803877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.854356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d92e-d793-4c1c-aa7e-91e9b07ecef4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.887248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.887910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.888184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.888450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.889147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.890621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.899447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b386b-5658-4c91-a5fd-8d57ba693756 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:54.930865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:54.931517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:54.931793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:54.932065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:54.932792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:54.933092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:54.934490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:54.942552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 97/191] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:54.943339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:54.999712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 95/192] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:10:54 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:55.000617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.053687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340d84-a1ab-4235-8e0f-627e4a54bfd5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.090122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.091064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.091348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.091677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.106869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.108375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.110447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 98/193] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:55.116610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f600-00ae-4c8e-90c3-c9387af6c759 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.117123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.153845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.155131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.155650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.156120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.157632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.160091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.162161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 96/194] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:54 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:55.169307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.244737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88211-4b48-4528-b51f-c491c4d5f6d4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.287219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.288497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.289136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.289626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.305115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e1d8e-d24d-4179-b3c1-e8d1e445731f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.352663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.353321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.353604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.354162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.377156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.380325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.433928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.435421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.513753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 99/195] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:55.518169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.540450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 97/196] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:55.545975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.639470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edce494-5f27-4d20-92e2-a4c91b100732 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.660275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787413a7-3301-472e-821e-3fa995403dc0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.679611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.680462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.680742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.681013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.682198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.683654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.685328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 100/197] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:55.697870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.708510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.709365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.709644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.709937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.711137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.712593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.715531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 98/198] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:55.722563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:55.807926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519ad4-9ccc-42f1-b3da-4edf76d6fd55 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.856930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b69ed-26b0-4d9c-808f-aeb29621a8df None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:55.868827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.869481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.869785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.870058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.870872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=4154198eef6e46feb88f86bb3ce4688d) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:55.871177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.872627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d958b-7eb7-425a-87ff-0a714bff9611 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.878225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 101/199] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/role_assignments?user.id=4154198eef6e46feb88f86bb3ce4688d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:55.906617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:55.907279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:55.907564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:55.907836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:55.909306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=4154198eef6e46feb88f86bb3ce4688d) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:55.909628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:55.911134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452f1d7-2f15-44bf-b212-9e8ecfb76d33 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:55.917501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 99/200] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:55 2022] GET /identity/v3/role_assignments?user.id=4154198eef6e46feb88f86bb3ce4688d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:56.897345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926233-0ae1-4045-a16b-c4ce5b539a7e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:56.897880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926233-0ae1-4045-a16b-c4ce5b539a7e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:56.897880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926233-0ae1-4045-a16b-c4ce5b539a7e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:56.899657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 102/201] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:56.905035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:56.905426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:56.905587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:56.929477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:56.930707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:57.013618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 100/202] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:57.058423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926233-0ae1-4045-a16b-c4ce5b539a7e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:57.202582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926233-0ae1-4045-a16b-c4ce5b539a7e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:57.252681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:57.253469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:57.253918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:57.254237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:57.270593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:57.277353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:10:57.278587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 103/203] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:57.286758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:57.432183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757626-607b-4964-9b7e-e62e4f63824a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:57.478564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:57.479693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:57.480171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:57.480653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:57.481620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:57.482183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:57.483860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:57.497456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 101/204] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:57.503153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:57.643263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa91-dcae-426a-9cb4-d76f9386767d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:57.690749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:57.691992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:57.692498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:57.692964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] PATH_INFO: `/v3/users/b736d2bf1e004838b3d2c517d1b682a8` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:57.698379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] RBAC: Authorizing `identity:get_user(user_id=b736d2bf1e004838b3d2c517d1b682a8)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:57.700060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f2f15-7a10-475b-89cc-6a2615c8e849 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:57.702226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 104/205] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:57 2022] GET /identity/v3/users/b736d2bf1e004838b3d2c517d1b682a8 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:57.708270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:57.834136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f7fcc-0204-4418-b4a3-e7a4ec82e1b5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:57.878173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:57.878875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:57.879159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:57.879423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:57.969605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:57.973257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:57.995503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302d1b-0b19-4686-a530-da9e9c609885 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:57.996424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302d1b-0b19-4686-a530-da9e9c609885 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:57.996859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302d1b-0b19-4686-a530-da9e9c609885 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.003536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 105/206] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:10:58.011019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.011578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.012252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.050653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:58.052179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:58.070677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 102/207] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:58.076085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.180646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04d8f-50a9-402b-9d9a-89d889fe10c9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.222451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.223313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.223587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.223855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.226226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:58.227700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:58.229616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 103/208] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:58.235675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 106/209] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:58.238025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.271166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.410868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c39fb-3dc2-41fe-9aba-9f137c62eb1c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.433451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6aaa-59dd-465d-8b45-c31f4f4f8044 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.456261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.457132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.457407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.457689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.480357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:58.488752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:10:58.490349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 107/210] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:10:58.495636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.515320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.515994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.516273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.516543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.517392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, scope.project.id=b06091d94fc345119033e2cdf17a8f92, user.id=b736d2bf1e004838b3d2c517d1b682a8) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:58.518254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:58.519711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373dde6-800a-4ff9-90b8-0a39426a2cfc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:58.536324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 104/211] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/role_assignments?user.id=b736d2bf1e004838b3d2c517d1b682a8&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=0308043db0c54638b0db187894b87790 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:10:58.568917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67a75-0a1c-4b03-8eab-c58bcb59fe16 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.569230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67a75-0a1c-4b03-8eab-c58bcb59fe16 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.569462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67a75-0a1c-4b03-8eab-c58bcb59fe16 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.571627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 105/212] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:58.582970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da277e7e-7155-4087-9a48-08b0ab9e953c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.583279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da277e7e-7155-4087-9a48-08b0ab9e953c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.583519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da277e7e-7155-4087-9a48-08b0ab9e953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.604166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4df6-8d22-4b97-bb02-d1bf8a12bc28 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.608201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-da277e7e-7155-4087-9a48-08b0ab9e953c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:58.609417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-da277e7e-7155-4087-9a48-08b0ab9e953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:58.640502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.641176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.641454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.641752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.643060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:58.643365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:58.644829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86019-db1b-4243-9723-fb2a553f23ca None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:58.654158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 108/213] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:58.655288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876056c6-d9b7-4398-9f00-f54dbed04ae5 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.655572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876056c6-d9b7-4398-9f00-f54dbed04ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.655843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876056c6-d9b7-4398-9f00-f54dbed04ae5 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.657541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 109/214] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:58.666908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876056c6-d9b7-4398-9f00-f54dbed04ae5 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.696339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 106/215] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:10:58.698151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.698443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.698725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.730202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:58.731742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:58.796125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876056c6-d9b7-4398-9f00-f54dbed04ae5 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.816789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 107/216] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:58.818060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.849570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.850497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.850773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.851041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] PATH_INFO: `/v3/users/de44e056dcd1477b8781a0afd49c8312` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.865532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] RBAC: Authorizing `identity:get_user(user_id=de44e056dcd1477b8781a0afd49c8312)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:58.867073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa0392-346c-431d-87c5-c6ebf7f65b59 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:58.868863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 110/217] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/users/de44e056dcd1477b8781a0afd49c8312 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:58.870128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b3c5-89cc-4755-80fe-067e36c8607b None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.870411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b3c5-89cc-4755-80fe-067e36c8607b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.870690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b3c5-89cc-4755-80fe-067e36c8607b None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.872285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 111/218] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:10:58.873933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b3c5-89cc-4755-80fe-067e36c8607b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.926230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37318-be2d-40aa-9d63-d73492de8032 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:58.958407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:58.959303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:58.959584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:58.959856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:58.961036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:58.962558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:58.964177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 108/219] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:58.968617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:58.970060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b3c5-89cc-4755-80fe-067e36c8607b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.004895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.005701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.005993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.006266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.016134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:59.023413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-15f23ac7-1960-4353-872e-f5d0807bce62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:10:59.024743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 112/220] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:59.025882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.026169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.026441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.043241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:10:59.044448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:10:59.063513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa149114-4f14-4294-a5d4-53ef3fdca210 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.095184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.096351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.096624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.096889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.107382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 113/221] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:10:59.108908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.160580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.162108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.200442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bab977-72e6-4e6c-8984-b3b02b926e03 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.232168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.232774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.233052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.233319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.234029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.235540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.252836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 109/222] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:10:59.253644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.344772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48a57-f81f-40fb-a97b-4e0b8c523f64 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.352824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 114/223] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:10:59 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:10:59.353644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.387884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.388576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.388859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.389136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.389932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:59.390236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.391707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.400673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 110/224] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.400673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.481139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412ba9-1322-4b85-a719-3fedd965a757 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.507975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40549-414b-4837-8bc2-a86b79153305 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.516502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.517349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.517706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.517991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.530857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:10:59.539237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:10:59.544875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 115/225] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:10:59.544875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.552775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.553648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.553996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.554270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.555476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.556957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.558699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 111/226] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.559453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.664984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b4b7-1331-4d85-b1a3-055631d7b4e5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.683731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90a6c-56d5-4ca4-9fa0-55edd5d7005c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.704625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.705506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.706023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.706300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.707514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.709018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.710679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 116/227] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.712124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.722048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.722714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.722990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.723255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.723989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:59.724287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.725692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.737977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 112/228] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.738831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.839079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735d1fd-ae20-4bbd-8c7a-685a2727c3b2 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.857129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0e79-2429-4d79-966f-9726e37e29de None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:10:59.881221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.881917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.882176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.882448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.883262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=de44e056dcd1477b8781a0afd49c8312) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:10:59.883578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.885002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.890738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 117/229] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/role_assignments?user.id=de44e056dcd1477b8781a0afd49c8312&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.891409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:10:59.906656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:10:59.907957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:10:59.909016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:10:59.910005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:10:59.912856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:10:59.916122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:10:59.919498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 113/230] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:10:59.929733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:00.035954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98dda0-2094-41d6-a937-1de97ef84c6f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:00.070793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:00.071689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:00.071971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:00.072245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/4154198eef6e46feb88f86bb3ce4688d/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:00.078676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, user_id=4154198eef6e46feb88f86bb3ce4688d, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:00.081011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:00.101898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b95d1-bbf9-4f75-ad00-06cc46b67f4a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:00.139312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:00.140195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:00.144969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:00.144969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:00.144969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:00.144969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:00.146044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 118/231] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:10:59 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:00.151210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:00.170726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 114/232] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:10:59 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/4154198eef6e46feb88f86bb3ce4688d/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:11:00.294895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1123-a387-4239-90e9-56f6d0e945b9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:00.332132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:00.332999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:00.333286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:00.333563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:00.334804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:00.338043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954a38-a4d8-493e-9872-9901bb019f4a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:00.339919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 119/233] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:00 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:00.346283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:00.472161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d902-ee70-4e35-8491-40365eff897b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:00.523029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:00.523966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:00.524252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:00.524526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/4154198eef6e46feb88f86bb3ce4688d/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:00.526982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, user_id=4154198eef6e46feb88f86bb3ce4688d, role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:00.528542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60c00d-6b93-415e-8647-c9c31000dec9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:00.628288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 115/234] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:00 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/4154198eef6e46feb88f86bb3ce4688d/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:02.079643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917ba6-ee19-410c-a315-de56de5d54b3 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.080918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917ba6-ee19-410c-a315-de56de5d54b3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.080989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917ba6-ee19-410c-a315-de56de5d54b3 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.082805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 120/235] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:02.088113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.088520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.088703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.119207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:02.120432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:02.171016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972c4f-aab3-4a4f-b187-f593fdf6ceac None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.171616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972c4f-aab3-4a4f-b187-f593fdf6ceac None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.172084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972c4f-aab3-4a4f-b187-f593fdf6ceac None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.174587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 121/236] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:02.180255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.180821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.181518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.199476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:02.200949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:02.277899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 116/237] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:02.322844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:02.327014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 122/238] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:02.392333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:02.506965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b17e0-620e-4dfe-ba98-da0c1c8946d4 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:02.549306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:02.550124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.550408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.550683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.553959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:02.555444 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:02.557258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 123/239] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:02.559919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d773-9d17-402b-92d2-7d0666ac8f30 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:02.563792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:02.622324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:02.623124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.623403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.623676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.654557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:02.661490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:02.671146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 117/240] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:02.687655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:02.706907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3fec-7df7-43f2-aa0e-f16aacabde99 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:02.750231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:02.750905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.751187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.751462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.752735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:02.754228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff91aa-1f6a-4484-949a-8222b5925533 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:02.840838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77955aa8-3980-4169-bb9d-d22ba0ea3b6f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:02.874480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 124/241] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:02 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:02.875629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c0abe-04d3-4dd3-a20f-826e3a0e17e1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.875734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:02.875939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c0abe-04d3-4dd3-a20f-826e3a0e17e1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.876236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c0abe-04d3-4dd3-a20f-826e3a0e17e1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.877008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.877008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.877008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.877779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:02.878109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:02.878284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 125/242] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:02.879807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:02.883829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:02.884092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:02.884371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:02.894557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 118/243] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:02.900264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:02.923000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:02.925575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:03.115102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 126/244] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:03.115709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c92a-cc2a-4a3a-84f5-fb6ca884e45b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.140623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.151404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.152296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.152615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.153204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] PATH_INFO: `/v3/users/8b1dba1b56994bbbadcdae1c613efd3d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.170622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1dba1b56994bbbadcdae1c613efd3d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.172704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.174579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 119/245] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:02 2022] GET /identity/v3/users/8b1dba1b56994bbbadcdae1c613efd3d => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:03.180049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.257465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9075-90f8-4ca7-b0f0-8e1ba0f34cc3 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.286909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32038f-4134-4c58-bdaf-8b788d090bc5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.294477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.295277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.295556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.295828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.307300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:03.314967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:03.320897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 127/246] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:03.321499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.322118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.322225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.322521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.322777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.393545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.394990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bad28-4a66-43a9-b722-dc3ff2e2f4f6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.425191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692f1c-dcfc-4d99-bfa4-f28ad7a982d0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.459847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874968c-bf15-4544-8994-833c6160116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.460514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874968c-bf15-4544-8994-833c6160116c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.460797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874968c-bf15-4544-8994-833c6160116c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.461074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874968c-bf15-4544-8994-833c6160116c None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.461853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874968c-bf15-4544-8994-833c6160116c None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:03.462158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874968c-bf15-4544-8994-833c6160116c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.463689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874968c-bf15-4544-8994-833c6160116c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.474243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 128/247] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:03.475907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44051db-5bca-470a-bcb3-805716fbba25 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.476352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44051db-5bca-470a-bcb3-805716fbba25 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.480233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44051db-5bca-470a-bcb3-805716fbba25 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.480233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 129/248] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:03.480233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44051db-5bca-470a-bcb3-805716fbba25 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.496139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 120/249] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:03.497464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.497767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.498042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.515106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:03.516273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:03.593283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 121/250] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:03.594168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.623778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44051db-5bca-470a-bcb3-805716fbba25 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.659564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.660356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.660640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.660916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] PATH_INFO: `/v3/users/de44e056dcd1477b8781a0afd49c8312` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.662177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] RBAC: Authorizing `identity:get_user(user_id=de44e056dcd1477b8781a0afd49c8312)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.663636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.665703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 130/251] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/users/de44e056dcd1477b8781a0afd49c8312 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:03.666063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.705843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12837d6a-1585-49b9-bc8f-ab57b566786c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.739931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.740782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.741060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.741328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.742523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.744016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.745721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 122/252] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:03.746479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.769991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007723-5cdc-4ca4-acbd-9d3a59c89c38 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.803947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed983-a810-405c-afa5-894530896c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.805076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed983-a810-405c-afa5-894530896c60 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.805556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed983-a810-405c-afa5-894530896c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.806069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed983-a810-405c-afa5-894530896c60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.819621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed983-a810-405c-afa5-894530896c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:03.826818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-253ed983-a810-405c-afa5-894530896c60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:11:03.828594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 131/253] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:03.831287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677cfff-1357-4135-845e-a3bdc97366e0 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.831782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677cfff-1357-4135-845e-a3bdc97366e0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.832250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677cfff-1357-4135-845e-a3bdc97366e0 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.838355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 132/254] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:03.839339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677cfff-1357-4135-845e-a3bdc97366e0 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.845908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7d06-a4cb-4a99-91f7-fa0232843bbc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.879666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.880522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.880799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.881126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.882305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:03.883761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:03.885436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 123/255] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:03.887136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:03.952152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677cfff-1357-4135-845e-a3bdc97366e0 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.991322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9933a7-871d-404b-866f-ca189a194e67 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:03.995562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:03.996480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:03.996974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:03.997441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:03.998484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=8b1dba1b56994bbbadcdae1c613efd3d) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:03.998997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.001049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8b9-2c51-465f-a9bc-ae3030f71a29 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.008554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 133/256] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/role_assignments?user.id=8b1dba1b56994bbbadcdae1c613efd3d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=0308043db0c54638b0db187894b87790 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:04.010111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.010617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.011139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.030839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:04.031951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.032622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.032934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.033036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:04.033202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.033970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:04.034269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.035679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.045589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 124/257] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:04.046357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.113758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 134/258] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:04.115001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.150181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d364f4-62fc-48d0-b4b9-eb7c591a1905 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.185320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.186240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.186522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.186820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/de44e056dcd1477b8781a0afd49c8312/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.188873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, user_id=de44e056dcd1477b8781a0afd49c8312, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.190966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.244211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813678f2-63ca-4333-895c-2dca7a7685f6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.270724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 125/259] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:04 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/de44e056dcd1477b8781a0afd49c8312/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:04.270724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.299573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.300503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.301145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.301429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.308287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.308287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.310292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 135/260] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:04.324014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.461181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fead-1b66-4c89-871b-dab844034dc7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.500935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.502220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.503098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.503731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.516593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:04.525235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:04.527149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 126/261] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:04.535528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.615868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adc78-e295-499a-8ec1-ce6cfdc5b882 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.664979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a3fa-e7a4-40e4-92c2-8dfdba939e9b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.694639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.695051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.695331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.695599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.703241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.704202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.704754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.705219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.706456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:04.706953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.708604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.721749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 127/262] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:04.724019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.826170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014c27-cda3-4de9-a844-3870e1d6f8e7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:04.840926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.842438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.862335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:04.863495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:04.863990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:04.864460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] PATH_INFO: `/v3/users/4154198eef6e46feb88f86bb3ce4688d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:04.865846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] RBAC: Authorizing `identity:get_user(user_id=4154198eef6e46feb88f86bb3ce4688d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:04.867609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:04.869407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 128/263] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/users/4154198eef6e46feb88f86bb3ce4688d => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:04.874802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:04.980058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aad5f-2bf0-4f65-8a48-a26fa6285881 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:05.013079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:05.013895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:05.014318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:05.014732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:05.061854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 136/264] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 25 03:11:05.070149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:05.083163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:05.089683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:05.183280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 129/265] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 25 03:11:05.188610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:05.287468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60719c3-fe10-4b82-bcf7-d60f98de6dcc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:05.289476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8c6b-dbb2-4996-9c80-c27fba1490f1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:05.321494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:05.322375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:05.322655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:05.322924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:05.324092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:05.325547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:05.327559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 130/266] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:05 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:05.333489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:05.363322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:05.364496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:05.364993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:05.365455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:05.370369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:05.372058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:05.373981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 137/267] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:05 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:05.379574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:05.434280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf994-5279-44f8-b215-ee646de2a82a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:05.468308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:05.468964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:05.469240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:05.469511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:05.470866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=4154198eef6e46feb88f86bb3ce4688d) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:05.471171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:05.472626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb670af-306d-4268-b373-7f944b4a4976 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:05.478806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 131/268] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:05 2022] GET /identity/v3/role_assignments?user.id=4154198eef6e46feb88f86bb3ce4688d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:05.529730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a31f5-921d-4495-84ee-81e3c9fc80c9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:05.567350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:05.568013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:05.568325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:05.568562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:05.569379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=4154198eef6e46feb88f86bb3ce4688d) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:05.569704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:05.571175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052edb24-b3b8-4248-bc01-862a6923fcf0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:05.577616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 138/269] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:05 2022] GET /identity/v3/role_assignments?user.id=4154198eef6e46feb88f86bb3ce4688d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:06.410062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9cc0-fce4-4729-bf5a-f56003f41bac None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.410567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9cc0-fce4-4729-bf5a-f56003f41bac None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.410668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9cc0-fce4-4729-bf5a-f56003f41bac None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.412403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 132/270] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:06.417759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.418165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.418352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.435832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:06.437057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:06.446207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcb5e-dbba-46c4-a2ac-06ac9df86101 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.446488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcb5e-dbba-46c4-a2ac-06ac9df86101 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.446759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcb5e-dbba-46c4-a2ac-06ac9df86101 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.448760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 133/271] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:06.453589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.453943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.454214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.471917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:06.473109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:06.511570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 139/272] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:06.537917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:06.543876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 134/273] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:06.570291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:06.640027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4c3e8-3d38-428f-bac7-45ddc9ca1c74 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:06.671445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1f51-7a99-4c81-825c-15d4972836ba None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:06.674351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:06.675141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.675419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.675688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.676865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:06.678348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:06.680321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 140/274] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:06.686103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:06.707574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:06.708362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.708637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.708907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.718964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:06.725792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:06.726984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 135/275] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:06.734864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:06.808727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c0e0-429c-4178-b7e2-8b8290e62da0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:06.838717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78598c-f690-4848-80cb-a6e287ae70b3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:06.851087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:06.852026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.852734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.853106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.854101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:06.856001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234beee-6a44-414f-a93b-ca1252394d3e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:06.872153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:06.872968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.873354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:06.873728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:06.874611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:06.874991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:06.877088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:06.889253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 136/276] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:06.891325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:06.988832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 141/277] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:06 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:06.997919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be57b-f354-4e87-89b4-8984acc32097 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:06.999664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59e07-94a5-45c2-8f67-fe480fa76714 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:06.999958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59e07-94a5-45c2-8f67-fe480fa76714 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.000234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59e07-94a5-45c2-8f67-fe480fa76714 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.005720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 142/278] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:07.011214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.011512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.011780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.040910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.042186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.042537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:07.042768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.043183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] PATH_INFO: `/v3/users/d6b919d250404c32a85b5f9c3bf59456` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.044414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:07.062601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] RBAC: Authorizing `identity:get_user(user_id=d6b919d250404c32a85b5f9c3bf59456)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:07.065479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:07.068572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 137/279] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:06 2022] GET /identity/v3/users/d6b919d250404c32a85b5f9c3bf59456 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:07.074025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.135524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 143/280] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:07.163400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.201409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ba42-b0b2-4230-86c3-f8aed8a84964 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.247532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.248510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.248996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.249267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.250131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, user.id=d6b919d250404c32a85b5f9c3bf59456, scope.system=all) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:07.250435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:07.252457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:07.265703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 138/281] 10.222.0.24 () {56 vars in 1308 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/role_assignments?user.id=d6b919d250404c32a85b5f9c3bf59456&scope.system=all&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:07.278473 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298ced-5a89-4d49-a865-ae5db870ff80 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.319024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.319848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.320128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.320397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.334660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:07.342240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-a8c4723c-1c34-48eb-b316-8997316e4fa6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:07.344376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 144/282] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:07.350539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.463640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea6d4-fcff-474e-99d3-46b907caaaaf None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.473375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52885c-ac78-4393-9b0a-a4d711c5b7e1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.473881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52885c-ac78-4393-9b0a-a4d711c5b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.473955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52885c-ac78-4393-9b0a-a4d711c5b7e1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.475830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 145/283] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:07.482008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.482408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.482781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.505360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:07.506891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:07.508003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.508671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.508949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.509220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.510171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:07.510475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:07.512701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:07.523087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 139/284] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:07.528567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.585784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 146/285] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:07.606767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.642046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a862c-8989-418c-8e9a-014cac4ba561 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.678001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.679198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.679611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.679884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] PATH_INFO: `/v3/users/8b1dba1b56994bbbadcdae1c613efd3d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.681066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1dba1b56994bbbadcdae1c613efd3d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:07.682709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:07.684788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 140/286] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/users/8b1dba1b56994bbbadcdae1c613efd3d => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:07.689643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.867872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c37c34-1424-4ff1-878a-033f60179ccc None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.928978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d7094-448b-41d3-8eef-76d19282b910 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:07.963010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.963723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.966837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.966837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.966992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:07.966992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:07.966992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:07.966992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:07.968150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:07.972901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:07.973252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 141/287] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:07.979005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:07.995276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:08.004032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:08.011919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 147/288] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:08.015602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:08.128703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488402-4075-405a-802b-e9567d2db733 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:08.174223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:08.175125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:08.175408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:08.175660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/8b1dba1b56994bbbadcdae1c613efd3d/roles/0308043db0c54638b0db187894b87790` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:08.184985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, user_id=8b1dba1b56994bbbadcdae1c613efd3d, role_id=0308043db0c54638b0db187894b87790)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:08.186485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:08.216871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095f5f-68c8-4360-9732-bc8dc9378961 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:08.249996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:08.250658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:08.250940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:08.251220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:08.252495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:08.252798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:08.254223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:08.262929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 148/289] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:08.268893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:08.306104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 142/290] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:07 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/users/8b1dba1b56994bbbadcdae1c613efd3d/roles/0308043db0c54638b0db187894b87790 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:08.381956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6dd4-7a5c-4cd5-ba8f-5a35473ef837 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:08.418142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:08.419422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:08.419932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:08.420405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] PATH_INFO: `/v3/users/de44e056dcd1477b8781a0afd49c8312` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:08.421999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] RBAC: Authorizing `identity:get_user(user_id=de44e056dcd1477b8781a0afd49c8312)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:08.423802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:08.426191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 149/291] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:08 2022] GET /identity/v3/users/de44e056dcd1477b8781a0afd49c8312 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:08.432170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:08.541346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdc251-5b91-4535-8cf9-25a403716bb4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:08.580149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:08.581420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:08.581950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:08.582419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:08.654683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:08.656525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:08.756633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 143/292] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:08.762472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:08.862064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809a92-dabf-4434-a59d-3b3031feffe6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:08.895931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:08.897150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:08.897628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:08.898148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:08.899552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:08.901207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f116d9-20ae-42ae-a0a3-69d960c733d0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:08.903433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 150/293] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:08 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:08.909500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:09.021051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c983964-68e7-44f2-842a-a0529b564a78 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:09.055989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:09.056935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:09.057394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:09.057899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:09.058938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=de44e056dcd1477b8781a0afd49c8312) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:09.059420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:09.061039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a10f33-5b2c-4859-ab42-3889170af1db None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:09.067596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 144/294] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:08 2022] GET /identity/v3/role_assignments?user.id=de44e056dcd1477b8781a0afd49c8312&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:09.846937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f6bb-c0d0-43e7-ba96-f35e3cd8dd20 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:09.847452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f6bb-c0d0-43e7-ba96-f35e3cd8dd20 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:09.847452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657f6bb-c0d0-43e7-ba96-f35e3cd8dd20 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:09.849490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 151/295] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:09.854705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:09.855105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:09.855292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:09.874173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:09.875356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:09.926632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c379c-4a7b-4e35-a51f-7d34a23a9b2c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:09.927159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c379c-4a7b-4e35-a51f-7d34a23a9b2c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:09.927675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c379c-4a7b-4e35-a51f-7d34a23a9b2c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:09.929876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 152/296] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:09.935437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e3ba-60bf-485b-8a97-7339679e480f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:09.935951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e3ba-60bf-485b-8a97-7339679e480f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:09.936425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e3ba-60bf-485b-8a97-7339679e480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:09.943464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 145/297] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:09.953860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2080e3ba-60bf-485b-8a97-7339679e480f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:09.955376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2080e3ba-60bf-485b-8a97-7339679e480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:09.965389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.040690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 153/298] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:10.041997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613c07-45c9-4179-9aaf-f94ff4fe0ef7 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.042215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613c07-45c9-4179-9aaf-f94ff4fe0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.042477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613c07-45c9-4179-9aaf-f94ff4fe0ef7 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.044298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 154/299] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:10.049742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.050094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.050373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.067005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:10.068184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:10.085296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36598c07-67f8-44df-9c4d-780ec53bbb8d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.119024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.119763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.120046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.120317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.130606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:10.135171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 155/300] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:10.137598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:10.143517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 146/301] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:10.143628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.144831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.242525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578d5e-c155-4399-b6f7-b6b8f1496673 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.248739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a950f-7be8-400d-a827-417b7cc8b5d4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.276849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.278009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.278522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.278946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.283120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.283781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.284187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.284470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.285221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:10.285507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.286919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.289633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:10.294661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 147/302] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:10.295633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.296873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:10.298615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 156/303] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:10.300558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.397542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b753f-1e75-4d57-966a-ddab3657373f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.405028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378819-9f79-4d32-8f18-d88952715f87 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.429518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.430386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.430669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.430935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.432072 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.433514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.440328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 148/304] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:10.440328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.445337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.446231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.446508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.447145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] PATH_INFO: `/v3/users/d6b919d250404c32a85b5f9c3bf59456` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.448630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] RBAC: Authorizing `identity:get_user(user_id=d6b919d250404c32a85b5f9c3bf59456)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.450576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.457765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 157/305] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/users/d6b919d250404c32a85b5f9c3bf59456 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:10.457765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.531261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844573-ed61-4a97-9a32-fb6d58a1cf15 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.554896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cd731-3fd0-4f45-9564-aaefc550381d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.564317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.564976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.565254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.565527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.566284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:10.566584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.567966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.580926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 149/306] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:10.580926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.594680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.595371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.595648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.595969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] PATH_INFO: `/v3/groups` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.596647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.598214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.670720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadd7d-26d5-4d33-8d69-fd9d49a0284b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.685919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 158/307] 10.222.0.24 () {60 vars in 1134 bytes} [Fri Mar 25 03:11:10 2022] POST /identity/v3/groups => generated 229 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:10.685919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.716132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.717017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.717301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.717577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] PATH_INFO: `/v3/system/users/d6b919d250404c32a85b5f9c3bf59456/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.719193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6b919d250404c32a85b5f9c3bf59456, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.720765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.805656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007b0-3b23-4899-831e-b832d6799f5a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:10.834230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 150/308] 10.222.0.24 () {58 vars in 1334 bytes} [Fri Mar 25 03:11:10 2022] PUT /identity/v3/system/users/d6b919d250404c32a85b5f9c3bf59456/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:10.846179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:10.847142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:10.847680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:10.847680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] PATH_INFO: `/v3/users/5703c40f9e1b4af597035d9c443be293` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:10.864746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] RBAC: Authorizing `identity:get_user(user_id=5703c40f9e1b4af597035d9c443be293)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:10.866394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ac2ff-b873-4663-96e6-fcbafda31b27 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:10.869702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 159/309] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/users/5703c40f9e1b4af597035d9c443be293 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:10.874214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:10.988871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d6cd-659f-45f9-8751-c5834a8b440b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:11.026850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:11.027560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.027844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.028114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.028995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, user.id=5703c40f9e1b4af597035d9c443be293, scope.system=all) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:11.029302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:11.030791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ccecc-4a61-4f7e-9447-de23cfcf1ee9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:11.037321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 151/310] 10.222.0.24 () {56 vars in 1308 bytes} [Fri Mar 25 03:11:10 2022] GET /identity/v3/role_assignments?user.id=5703c40f9e1b4af597035d9c443be293&scope.system=all&role.id=0308043db0c54638b0db187894b87790 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:11.119013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbe4-ba03-47ef-a8a0-9cb23ee56a06 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.119344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbe4-ba03-47ef-a8a0-9cb23ee56a06 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.119573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbe4-ba03-47ef-a8a0-9cb23ee56a06 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.121572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 160/311] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:11.128099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.128704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.129203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.147461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:11.149018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:11.226553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 152/312] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:11.250781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fbe4-ba03-47ef-a8a0-9cb23ee56a06 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:11.350172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fbe4-ba03-47ef-a8a0-9cb23ee56a06 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:11.383384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:11.384175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.384457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.384732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.394916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:11.401817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:11.403002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 161/313] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:11.409240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:11.508042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544d87-a711-4fea-a74e-11cced98e179 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:11.541348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:11.542043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.542322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.542590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.543321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:11.543621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:11.544994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:11.553541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 153/314] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:11.558992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:11.662820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9346d3-5871-4703-8903-efbd524410e3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:11.696908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:11.697797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.698079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.698348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] PATH_INFO: `/v3/users/8b1dba1b56994bbbadcdae1c613efd3d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.699540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1dba1b56994bbbadcdae1c613efd3d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:11.700986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:11.702619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 162/315] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:11 2022] GET /identity/v3/users/8b1dba1b56994bbbadcdae1c613efd3d => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:11.710281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:11.806630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd6ea-06ee-4a2a-906a-36186c06997d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:11.844347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:11.845063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:11.845345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:11.845619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:11.913683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:11.915160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:12.026516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 154/316] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:12.031583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:12.139038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17385a7-3409-4484-ad10-5efd6e16d248 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:12.174163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:12.175024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:12.175309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:12.175582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:12.176769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:12.178250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be423-5137-4618-8b4f-0b59ab4024a6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:12.180242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 163/317] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:12 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:12.185875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:12.287999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c8e-ec28-4f4e-8922-d2fe955cf3b3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:12.321815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:12.322475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:12.322756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:12.323029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:12.323839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e, user.id=8b1dba1b56994bbbadcdae1c613efd3d) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:12.324144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:12.325585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa911f-eace-49d7-a680-b73c4351d405 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:12.332503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 155/318] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:12 2022] GET /identity/v3/role_assignments?user.id=8b1dba1b56994bbbadcdae1c613efd3d&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=0308043db0c54638b0db187894b87790 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:13.116163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4bfe-3ad7-4533-a559-31022b0ffbc6 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.116673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4bfe-3ad7-4533-a559-31022b0ffbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.116780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4bfe-3ad7-4533-a559-31022b0ffbc6 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.118566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 164/319] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:13.123888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5736-4bd4-4a06-9cdc-7eeabcd91516 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.124289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5736-4bd4-4a06-9cdc-7eeabcd91516 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.124440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5736-4bd4-4a06-9cdc-7eeabcd91516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.141223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2b6b5736-4bd4-4a06-9cdc-7eeabcd91516 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:13.143132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2b6b5736-4bd4-4a06-9cdc-7eeabcd91516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:13.207310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 156/320] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:13.230565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4bfe-3ad7-4533-a559-31022b0ffbc6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.260244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f33f1-6bec-47b5-bca0-57736795198f None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.260530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f33f1-6bec-47b5-bca0-57736795198f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.260978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f33f1-6bec-47b5-bca0-57736795198f None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.262781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 157/321] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:13.268145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9af5e-6541-492e-a33a-e52538c80823 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.268429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9af5e-6541-492e-a33a-e52538c80823 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.268701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9af5e-6541-492e-a33a-e52538c80823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.286285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-89a9af5e-6541-492e-a33a-e52538c80823 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:13.287458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-89a9af5e-6541-492e-a33a-e52538c80823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:13.329889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4bfe-3ad7-4533-a559-31022b0ffbc6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.352354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 158/322] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:13.354026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403e05-c46d-4870-b977-06249eb0b460 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.354311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403e05-c46d-4870-b977-06249eb0b460 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.354581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403e05-c46d-4870-b977-06249eb0b460 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.356348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 159/323] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:13.361879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.362167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.362441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.364072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.364880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.365167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.365444 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.366628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:13.368088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:13.369745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 165/324] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:13.375108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.379568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:13.380739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:13.447310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 160/325] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:13.448757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.471307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b054a1f-7439-47d9-a158-b548caf7a6db None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.503345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.503942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.504234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.504507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] PATH_INFO: `/v3/groups` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.505187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:13.506660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:13.540868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175b49-59a0-4bb9-8862-d481e746676d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.572759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.573535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.573843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.574114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.584079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:13.590998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:13.592048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 166/326] 10.222.0.24 () {60 vars in 1134 bytes} [Fri Mar 25 03:11:13 2022] POST /identity/v3/groups => generated 226 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:11:13.605904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 161/327] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:13.605999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.606113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.699436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa37b1-6ffb-4482-93fc-ac5ad56e0026 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.702593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f1c6a-bec4-4585-9c63-0b5608a33bd6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.733708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.734519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.734818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.735082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.737224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.738131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.738607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.739059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.739973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:13.740446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:13.742035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:13.747000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:13.751302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 162/328] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:13.754233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:13.755561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 167/329] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:13.756810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.761335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.860195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937b48-7125-4903-a7b6-0ea236c0297c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.878511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8da4-d9ba-41e7-b106-c8842e369988 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:13.894207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.896139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.896421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.896701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] PATH_INFO: `/v3/users/d6b919d250404c32a85b5f9c3bf59456` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.897931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] RBAC: Authorizing `identity:get_user(user_id=d6b919d250404c32a85b5f9c3bf59456)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:13.899389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:13.901212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 168/330] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/users/d6b919d250404c32a85b5f9c3bf59456 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:13.906621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:13.918364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:13.919035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:13.919312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:13.919583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:13.920343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:13.920640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:13.922049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:13.930588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 163/331] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:13.937830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:14.012829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead263a0-c23f-47a2-aef2-f778a0d539a6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:14.050238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:14.051292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:14.051758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:14.052222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:14.053215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] RBAC: Adding query filter params (role.id=6c92be9ce56e4845a791f4b0886eb2c0, user.id=d6b919d250404c32a85b5f9c3bf59456, scope.system=all) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:14.053724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:14.055505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:14.064817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a33c-f2d8-4546-9e99-33e848c4d770 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:14.068083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 169/332] 10.222.0.24 () {56 vars in 1308 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/role_assignments?user.id=d6b919d250404c32a85b5f9c3bf59456&scope.system=all&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:14.109351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:14.110672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:14.111116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:14.111543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] PATH_INFO: `/v3/users/5703c40f9e1b4af597035d9c443be293` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:14.113055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=5703c40f9e1b4af597035d9c443be293)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:14.114734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22214384-5a1d-4bc5-89a0-5a36df648ad0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:14.121253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 164/333] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:13 2022] GET /identity/v3/users/5703c40f9e1b4af597035d9c443be293 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:14.122868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:14.233794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed670a-a85c-4596-af94-cc66f0717732 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:14.270318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:14.271420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:14.271855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:14.272280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] PATH_INFO: `/v3/system/users/5703c40f9e1b4af597035d9c443be293/roles/0308043db0c54638b0db187894b87790` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:14.273966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5703c40f9e1b4af597035d9c443be293, role_id=0308043db0c54638b0db187894b87790)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:14.275517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4320-69c0-4273-a407-63bce773eedb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:14.440159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 170/334] 10.222.0.24 () {58 vars in 1334 bytes} [Fri Mar 25 03:11:14 2022] PUT /identity/v3/system/users/5703c40f9e1b4af597035d9c443be293/roles/0308043db0c54638b0db187894b87790 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:16.435402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77830-09a2-4161-8b2f-7122e6eb5633 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:16.435950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77830-09a2-4161-8b2f-7122e6eb5633 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:16.436220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77830-09a2-4161-8b2f-7122e6eb5633 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:16.438244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 165/335] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:16.444361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66292-87f8-436a-a273-2155bd75b8a7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:16.444834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66292-87f8-436a-a273-2155bd75b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:16.444916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66292-87f8-436a-a273-2155bd75b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:16.467118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-26e66292-87f8-436a-a273-2155bd75b8a7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:16.468346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-26e66292-87f8-436a-a273-2155bd75b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:16.558479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 171/336] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:16.604928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77830-09a2-4161-8b2f-7122e6eb5633 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:16.721532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cd9f-c34f-4efd-8648-8bf2eef1d802 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:16.721861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cd9f-c34f-4efd-8648-8bf2eef1d802 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:16.722041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cd9f-c34f-4efd-8648-8bf2eef1d802 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:16.723998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 172/337] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:16.727160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77830-09a2-4161-8b2f-7122e6eb5633 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:16.731924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:16.732210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:16.732488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:16.770174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:16.771373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:16.777812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:16.778672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:16.778949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:16.779220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:16.799694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:16.808531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:16.814440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 166/338] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:16.820268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:16.909686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 173/339] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:16.969565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdad60-03d7-40d8-8d0f-0d3e4bf6e1b4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:16.979886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.041508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.042209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.042489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.043000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.043768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:17.044067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:17.045471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc377-5deb-4f64-abe1-025fbed73da7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:17.065306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 167/340] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:17.066874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c63aca-96ea-45e4-abf3-0baae33bd3cf None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.067166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c63aca-96ea-45e4-abf3-0baae33bd3cf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.067437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c63aca-96ea-45e4-abf3-0baae33bd3cf None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.071196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 168/341] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:17.075104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.075389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.080097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.101127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:17.102528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:17.176595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb09ae4-4a9c-49ed-a561-3983cadf5733 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.225648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 169/342] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:17.229270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.251929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.251929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.251929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.251929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.272876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:17.281306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:17.287910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 174/343] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:17.288882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.395402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8a34-0f37-4102-b65d-32ab483499e5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.415838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba78c-8d07-449f-8785-b419e7584dba None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.429008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.429855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.431399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.431399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.443602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:17.450531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:17.452101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 175/344] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:17.452954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.464115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.464763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.465035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.465402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.552639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:17.556233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:17.557423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3bbe9-1e2e-4569-936a-b6020f64cf6f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.595018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.595688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.595972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.596249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.596999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:17.597305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:17.598819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:17.613567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 176/345] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:17.614502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.658569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 170/346] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:17.659427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.719395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448786-4609-46b5-95ca-b63238b68eef None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.754278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.754953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.755235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.755511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.756251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:17.756557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:17.757969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:17.766821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 177/347] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:17.767744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.868884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4f93-d29b-4b5a-9844-2322789f6006 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.881974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06f0d-da53-4316-b202-d86b6984e908 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:17.916780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.917645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.917971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.918290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:17.919535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:17.921022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:17.923457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 178/348] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:17.924298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:17.938946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:17.939557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:17.939832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:17.940099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.029892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4a42-b7b9-4053-8c6e-c91a5d1c0b7a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.040111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.041586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.065285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.066211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.066638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.067076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.163875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.166031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.207648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 171/349] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:18.208706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.332265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 179/350] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:18.335266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.356352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05da215-e25c-4a3d-a84a-292b3a8d0cab None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.407540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.408398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.408676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.408946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.415146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.416542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d27b9-0057-4323-b9b9-6348815122ba None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.418260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 172/351] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.419599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0d3c-820c-49fc-9169-23cd60fb8262 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.419890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0d3c-820c-49fc-9169-23cd60fb8262 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.420168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0d3c-820c-49fc-9169-23cd60fb8262 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.421969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 173/352] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:18.422598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0d3c-820c-49fc-9169-23cd60fb8262 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.463857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16d03-9295-4ad4-868e-7e391bbc5c28 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.505752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.506876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.507311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.507722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.509079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.510728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452dc90-b18e-4e2e-9db9-93f259b5949d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.512699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 180/353] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.514099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d32d-4c13-8177-d6d5c3de60aa None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.514525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d32d-4c13-8177-d6d5c3de60aa None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.514930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d32d-4c13-8177-d6d5c3de60aa None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.517002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 181/354] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:18.521438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.521438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.521438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.542001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:18.543503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:18.549169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0d3c-820c-49fc-9169-23cd60fb8262 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.597074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.598591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.599034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.599443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.601158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.604010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.606326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 174/355] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.607735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.637749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 182/356] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:18.639064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.725038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895d3e-e7ad-4a8f-ba51-117b3d647f1b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.748668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36462-a91d-444b-9425-5715bb9a2ed6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.762710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.763376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.763640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.763908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.764719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=b06091d94fc345119033e2cdf17a8f92) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:18.765024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.767097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb1d5-beac-4638-a354-b2a63b927d8e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 175/357] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6036-67ab-4cb4-ad7e-c96fccb64339 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6036-67ab-4cb4-ad7e-c96fccb64339 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6036-67ab-4cb4-ad7e-c96fccb64339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.791606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.792496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.792834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.793112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.796877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.798248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-969a6036-67ab-4cb4-ad7e-c96fccb64339 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:18.798500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.799820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-969a6036-67ab-4cb4-ad7e-c96fccb64339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:18.800431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 183/358] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.801041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.893345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 176/359] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:18.894895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c695-9071-42c4-862a-45d2d79aef76 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.895350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c695-9071-42c4-862a-45d2d79aef76 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.895752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c695-9071-42c4-862a-45d2d79aef76 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.897849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 177/360] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:18.898747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570c695-9071-42c4-862a-45d2d79aef76 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:18.934365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf3c2-1a0f-4d32-81fb-245d8d78643a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:18.987778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:18.988965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:18.989462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:18.989902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:18.991182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:18.993695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:18.995508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 184/361] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:18.996413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.028020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570c695-9071-42c4-862a-45d2d79aef76 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.082037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.083209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.083209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.083402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.095708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:19.103111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1d8204b2-c426-495c-9498-903ab22490b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:19.104970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 178/362] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:19.106350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.106817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.107292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.116558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c321eb-8649-47cc-b7ad-681a5ee42ac3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.127165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:19.128699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:19.158120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.158780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.159061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.159333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.160146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:19.160624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.162255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.168149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 185/363] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:18 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:19.169304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.216015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 179/364] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:19.217655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.306524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611c658-7cce-4590-b7db-fe582c7fb647 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.344233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.345335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.345787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.346236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.353433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384e40-0212-4f99-a7e2-4f0398c970a6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.357886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:19.365841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 25 03:11:19.367632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 186/365] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:19.368642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.395800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.396409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.396692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.396964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.397849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=b06091d94fc345119033e2cdf17a8f92) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:19.398162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.399705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.405720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 180/366] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:19.406631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.478308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92daec8-6d32-4533-84e9-d0ecb6a6fff6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.514314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.515327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.515809 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.516307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.517873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:19.518409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.519993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.520633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c56a-9043-4656-9b74-487b502b34ff None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.529899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 187/367] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:19.531126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.562205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.562850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.563092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.563897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.575888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:19.583539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:11:19.585055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 181/368] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:19.585486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.662654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dab597-fc28-4296-89af-6a3ac5b7bc1b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.704162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.705197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.705964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.706435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.707407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:19.707930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.709549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.717301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f382-eb9f-4dc2-85ec-05b13706df6b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.718855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 188/369] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:19.720561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:19.761216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.761905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.762188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.762462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.853448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e8cd-efea-4107-89cf-d2199f6e6730 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:19.862576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.866080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.909390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:19.911139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:19.911797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:19.913355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:19.914398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:19.915557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:19.917772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:19.940104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 189/370] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:19.940104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.031386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 182/371] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:20.033201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.123499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64a1b-06fa-4c5c-b125-a471572b52fb None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.162814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.164073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.164557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.165042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] PATH_INFO: `/v3/users/5703c40f9e1b4af597035d9c443be293` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.166626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] RBAC: Authorizing `identity:get_user(user_id=5703c40f9e1b4af597035d9c443be293)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.168526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.171089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 190/372] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:11:19 2022] GET /identity/v3/users/5703c40f9e1b4af597035d9c443be293 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:20.172188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.263912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65963-262d-4c59-8dce-1d56bcc4a96f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.286494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32c319-7914-4f1e-9ef5-ccb32da32750 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.323723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.324926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.325451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.325954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.327896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.329582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.332057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 191/373] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:20.333347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.350364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.351021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.351622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.351622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.445555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19233b9c-d01e-4687-8028-8a0177087aa2 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.484227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.485937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.486621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.487104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.488123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] RBAC: Adding query filter params (role.id=0308043db0c54638b0db187894b87790, user.id=5703c40f9e1b4af597035d9c443be293, scope.system=all) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:20.488631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.490778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.502275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.503743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.505740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 192/374] 10.222.0.24 () {56 vars in 1308 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/role_assignments?user.id=5703c40f9e1b4af597035d9c443be293&scope.system=all&role.id=0308043db0c54638b0db187894b87790 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:20.506833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.624621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d272d-c52e-4caa-98c5-309195ccf933 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.666266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.668079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.668640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.669130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.670702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.672413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.674694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 193/375] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:20.681239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.775151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 183/376] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:20.804254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:20.937641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb4a9-1a42-4f78-88f0-a42033b794d1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.948152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595a36-df8f-4845-b90f-1962ee3d8cdc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:20.988567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.990245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.990769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.991270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] PATH_INFO: `/v3/projects/b1302222fc7241c1bba468ff84d0f185` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.992847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b1302222fc7241c1bba468ff84d0f185)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.993297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:20.994077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:20.994452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:20.994822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:20.995170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:20.995824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:20.996228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:20.997645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 184/377] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/projects/b1302222fc7241c1bba468ff84d0f185 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:20.999912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:21.004869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 194/378] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:20 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:21.006144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:21.113394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2d20-5933-4ad8-8919-7c874b32a6b6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:21.151248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:21.152380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:21.152828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:21.153267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] PATH_INFO: `/v3/groups/6699b3211f5746e5adf856a8d063d437` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:21.159923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] RBAC: Authorizing `identity:get_group(group_id=6699b3211f5746e5adf856a8d063d437)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:21.161631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a298-2ea4-4a05-8cfd-4cb659e79d5d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:21.163552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 185/379] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:21 2022] GET /identity/v3/groups/6699b3211f5746e5adf856a8d063d437 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:21.170556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:21.281577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a966b-3352-4dfc-8813-493f179536c3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:21.317649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:21.318573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:21.319002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:21.319418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:21.320402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] RBAC: Adding query filter params (group.id=6699b3211f5746e5adf856a8d063d437, role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=b1302222fc7241c1bba468ff84d0f185) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:21.320856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:21.322459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15759e1b-36ff-45ec-9bbe-f63e0ed3bec6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:21.329366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 195/380] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:21 2022] GET /identity/v3/role_assignments?group.id=6699b3211f5746e5adf856a8d063d437&scope.project.id=b1302222fc7241c1bba468ff84d0f185&role.id=36a26de00c7141a09176dacfb7236db0 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:21.920990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14808c-272f-47cc-9f08-2b1b17e6ed38 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:21.921893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14808c-272f-47cc-9f08-2b1b17e6ed38 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:21.922330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14808c-272f-47cc-9f08-2b1b17e6ed38 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:21.924363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 186/381] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:21.929972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d26fe-62b7-4978-9c7a-23f9abdb7bce None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:21.930414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d26fe-62b7-4978-9c7a-23f9abdb7bce None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:21.930519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d26fe-62b7-4978-9c7a-23f9abdb7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:21.950896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-720d26fe-62b7-4978-9c7a-23f9abdb7bce None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:21.952123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-720d26fe-62b7-4978-9c7a-23f9abdb7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:22.034918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 196/382] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:22.058837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14808c-272f-47cc-9f08-2b1b17e6ed38 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.202822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14808c-272f-47cc-9f08-2b1b17e6ed38 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.225738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d96cc-dc36-4bb1-97da-63ef0ab0f7c2 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.225738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d96cc-dc36-4bb1-97da-63ef0ab0f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.225738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d96cc-dc36-4bb1-97da-63ef0ab0f7c2 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.226434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 197/383] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:22.232477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a2a3-607d-4889-a395-b166b56f287a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.232767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a2a3-607d-4889-a395-b166b56f287a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.233047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a2a3-607d-4889-a395-b166b56f287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.245068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.245910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.246192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.246466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.261211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ec55a2a3-607d-4889-a395-b166b56f287a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:22.262458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ec55a2a3-607d-4889-a395-b166b56f287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:22.268059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:22.275437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:22.277432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 187/384] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:22.287072 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.396304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 198/385] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:22.446869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcae48-11f3-4cf1-bfe9-9341c8bd5d31 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.460965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4060bb-e059-4561-b1eb-e76f990147e9 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.461461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4060bb-e059-4561-b1eb-e76f990147e9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.461904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4060bb-e059-4561-b1eb-e76f990147e9 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.463980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 199/386] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:22.468778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4060bb-e059-4561-b1eb-e76f990147e9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.492169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.492888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.493328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.493617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.494728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:22.495043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:22.496458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268865a7-23fa-43f6-9b28-e50be3f0cd2e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:22.508648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 188/387] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:22.510019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.510315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.510595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.529611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:22.531354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:22.602069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4060bb-e059-4561-b1eb-e76f990147e9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.612375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 189/388] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:22.613305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.646683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.647753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.647753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.648014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.661592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:22.668692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:22.671085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 200/389] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:22.672071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.746524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72bd2-f3af-4b6d-b914-8f0e63238add None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.787328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d5064-8af2-40a1-849d-3478b02c0cf9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.790387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.791470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.791944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.792425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.793854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:22.795510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:22.801893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 190/390] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:22.802970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.830856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.832104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.832535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.833269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.848461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:22.858675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:22.861020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 201/391] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:22.862092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.918623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17c8a-8e68-420d-bda3-e97008e4adb6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:22.964778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:22.966170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:22.966661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:22.967122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:22.968047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:22.968550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:22.975383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:22.986239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 191/392] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:22.987466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:22.993251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0256-8f56-45a8-b899-2966d9073dcc None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.031188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.032534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.032826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.033102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.034561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.035861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.037538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 202/393] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.041842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.114867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725555-e52d-4438-93a1-bcacde274b50 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.140364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcca89-6ba8-45b3-a5fe-bb9fdde7f501 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.155895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.157624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.158412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.158892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.159833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:23.160346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.162672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.174122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 192/394] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.177847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.181618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.182613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.182998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.183370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.184672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.186246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.188871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 203/395] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:23 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.189850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.286931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349acf2-b44c-4719-969e-5ff0151e9620 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.290163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b22ae-ed0f-49ce-bbb7-955cba315511 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.321762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.322949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.323385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.323805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/groups/0e984a5ca66249d7becea490530d3cdb/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.323973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.324824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.325105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.325375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.326569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.327109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, group_id=0e984a5ca66249d7becea490530d3cdb, role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.328147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.329462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.331070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 204/396] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:23 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.331927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.415122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 193/397] 10.222.0.24 () {58 vars in 1442 bytes} [Fri Mar 25 03:11:23 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/groups/0e984a5ca66249d7becea490530d3cdb/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:23.415956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.436835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393813cd-3968-4534-86cc-1c86f0fb9fab None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.511272 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.512151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.512431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.512702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.514933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.516662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.518947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 205/398] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:23 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.526450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.604027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858c2b5-6c44-4239-94ec-8c6256ad0d5e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.661406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6106-b859-4cf4-a7aa-41985dbd9e9a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.676056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.677338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.677981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.678547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.679960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.681732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.684000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 194/399] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:23 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:23.689902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:23.701694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.702548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.702835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.703108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/groups/0e984a5ca66249d7becea490530d3cdb/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.705187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, group_id=0e984a5ca66249d7becea490530d3cdb, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.707114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605aecad-13d3-4e81-9bf5-3f67ca56f30e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:23.787410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 206/400] 10.222.0.24 () {58 vars in 1442 bytes} [Fri Mar 25 03:11:23 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/groups/0e984a5ca66249d7becea490530d3cdb/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:23.824547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667fde-dff3-47ed-b3e3-a2b10f62a22c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:23.867173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:23.868003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:23.868288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:23.868562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92/groups/0e984a5ca66249d7becea490530d3cdb/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:23.874741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] RBAC: Authorizing `identity:create_grant(project_id=b06091d94fc345119033e2cdf17a8f92, group_id=0e984a5ca66249d7becea490530d3cdb, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:23.876812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb3f1f-aadb-46d1-a268-41effdda086a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:24.008084 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 195/401] 10.222.0.24 () {58 vars in 1442 bytes} [Fri Mar 25 03:11:23 2022] PUT /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92/groups/0e984a5ca66249d7becea490530d3cdb/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:11:24.139954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628c21f-2d51-4904-ba15-8e1b6ef7286e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.140445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628c21f-2d51-4904-ba15-8e1b6ef7286e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.140445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628c21f-2d51-4904-ba15-8e1b6ef7286e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.142587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 207/402] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:24.148049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.148331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.148606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.167850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:24.168594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa22c8d-019a-429d-85d2-0fe3a17f8fc0 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.168884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa22c8d-019a-429d-85d2-0fe3a17f8fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.169045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:24.169196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa22c8d-019a-429d-85d2-0fe3a17f8fc0 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.171236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 208/403] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:24.177223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.177503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.177840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.195658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:24.196869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:24.245819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 196/404] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:24.263990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.272100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 209/405] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:24.305616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.379269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ab9b-c73a-4dfd-b4cb-97ffbaca810c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.431497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.432225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.432503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.432773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.444700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:24.452873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:24.456797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff4c8-85aa-4d67-be0d-ffa8a37a67e7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.457808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 197/406] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:24.461845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.521567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.522386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.522669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.522939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.545904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:24.553240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:11:24.554454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 210/407] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:24.569262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.624519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451601-118d-4aa1-9936-ee58faa2ffb5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.658715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.659383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.659667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.659942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.660688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:24.660990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:24.662404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:24.671067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 198/408] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:24.688662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.696864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca227-f3d5-4fcd-be2f-e8302ccc80f7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.736476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.737140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.737417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.737715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.738461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:24.738763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:24.740366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:24.755260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 211/409] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:24.761939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.875964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330197-e827-4c3c-b767-d56de7682bb6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.899338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f668ea6-ae0b-4d6e-9de1-1d353ba491a8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:24.934542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.935464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.935745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.936023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] PATH_INFO: `/v3/groups/6699b3211f5746e5adf856a8d063d437` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.937170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] RBAC: Authorizing `identity:get_group(group_id=6699b3211f5746e5adf856a8d063d437)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:24.939198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:24.941064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 212/410] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/groups/6699b3211f5746e5adf856a8d063d437 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:24.947949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:24.987003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:24.987880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:24.988169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:24.988450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:24.989637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:24.991134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:24.993061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 199/411] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:25.010646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:25.068300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3a9a-69ee-4de7-86b9-dcabd19ab520 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:25.105552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:25.106488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:25.106767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:25.107034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] PATH_INFO: `/v3/projects/b1302222fc7241c1bba468ff84d0f185` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:25.108194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] RBAC: Authorizing `identity:get_project(project_id=b1302222fc7241c1bba468ff84d0f185)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:25.109626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:25.112331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 213/412] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:24 2022] GET /identity/v3/projects/b1302222fc7241c1bba468ff84d0f185 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:25.118727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:25.228707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576615d-d02b-4d94-a0eb-164ff76ded04 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:25.241297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271cda9-4631-4f67-bd58-7832d05ae183 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:25.264093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:25.265052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:25.265328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:25.265648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] PATH_INFO: `/v3/projects/b1302222fc7241c1bba468ff84d0f185/groups/6699b3211f5746e5adf856a8d063d437/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:25.269464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1302222fc7241c1bba468ff84d0f185, group_id=6699b3211f5746e5adf856a8d063d437, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:25.270952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31913d62-dc25-443a-af64-fb2a45fbe133 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:25.294155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:25.295013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:25.295292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:25.295563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:25.296761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:25.298275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:25.300275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 200/413] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:25 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:25.305620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:25.353012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 214/414] 10.222.0.24 () {58 vars in 1442 bytes} [Fri Mar 25 03:11:25 2022] PUT /identity/v3/projects/b1302222fc7241c1bba468ff84d0f185/groups/6699b3211f5746e5adf856a8d063d437/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:25.424859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d62fe-b073-4387-8069-4990847df8d5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:25.467855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:25.468759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:25.469039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:25.469856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/groups/0e984a5ca66249d7becea490530d3cdb/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:25.472245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe7ef74399c4347a918ab1c2dc31d8e, group_id=0e984a5ca66249d7becea490530d3cdb, role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:25.473774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb4b49-f476-4160-87c1-5b99ff04930d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:25.542538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 201/415] 10.222.0.24 () {58 vars in 1442 bytes} [Fri Mar 25 03:11:25 2022] PUT /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e/groups/0e984a5ca66249d7becea490530d3cdb/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:11:25.996685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f612-42f1-4e3f-9cf2-98c2f8c1e6db None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:25.997033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f612-42f1-4e3f-9cf2-98c2f8c1e6db None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:25.997380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f612-42f1-4e3f-9cf2-98c2f8c1e6db None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:25.999404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 215/416] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:26.004882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.005169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.005446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.023734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:26.025559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:26.119552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 202/417] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:26.149262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f612-42f1-4e3f-9cf2-98c2f8c1e6db None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:26.292729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f612-42f1-4e3f-9cf2-98c2f8c1e6db None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:26.335640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:26.336687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.337104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.337512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.355295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:26.365018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-d5868881-aff7-46fd-9176-64036b8d55dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:26.366440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 216/418] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:26.372059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:26.490970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a47d-0fc4-4add-bf2c-17a40f774ef9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:26.542232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:26.544589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ab4c-66b7-4f66-90e2-d2471e09d215 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.545045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ab4c-66b7-4f66-90e2-d2471e09d215 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.545456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ab4c-66b7-4f66-90e2-d2471e09d215 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.547396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 217/419] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:26.547892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.548422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.548850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.549761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:26.550214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:26.551879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:26.552128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.552589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.553022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.560874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 203/420] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:26.566706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:26.590663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:26.592135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:26.708737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 218/421] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:26.724456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dca84-c4db-45b2-9ba6-f6475f17beb9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:26.746727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:26.769587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:26.770270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:26.770551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:26.770824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:26.853586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:26.855759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:26.965972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 204/422] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:26.974731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:26.977641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92be4-fb60-4d57-ba65-8fa52ab69bf8 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.015931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.016960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.017573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.019037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.040657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:27.048129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:27.057683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 219/423] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:27.058751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.105132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c84cd-eb4c-4d31-8137-d235d5b98879 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.152972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.153858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.154142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.154419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.156026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.158055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.163938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 205/424] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:26 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:27.165041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.215060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac6a7a-575e-436b-a320-fa1e765f55d3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.260570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.261238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.261705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.262153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.263045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:27.263494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.265010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38e27a-d0f0-4735-8c4d-741f2d7a4ff2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.274306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 220/425] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:27.275932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac019-d0f8-436d-ae96-4c1a406fe01a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.276418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac019-d0f8-436d-ae96-4c1a406fe01a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.276887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac019-d0f8-436d-ae96-4c1a406fe01a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.278796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 221/426] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:27.279657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac019-d0f8-436d-ae96-4c1a406fe01a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.295797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f8cb-0530-4768-a995-2c38fbdcc045 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.330018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.331332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.331753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.332177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.333487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.335108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd011-7033-4d8c-89f6-f5b8b57414f7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.337176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 206/427] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:27.338548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.338966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.339373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.356438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:27.357817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:27.396499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac019-d0f8-436d-ae96-4c1a406fe01a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.435046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 207/428] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:27.436156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.437055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.438054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.438769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.440133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.524861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.526634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.560141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834509b4-226a-4a14-998f-09bf60cc5adb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.603844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.605186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.605647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.606106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.607503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=b06091d94fc345119033e2cdf17a8f92) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:27.608297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.610267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.618667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 208/429] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:27.619806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.635731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 222/430] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:27.637016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.732713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c90fb-46af-40a6-bfae-3061ebcb3efc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.770947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464e79-835c-4e92-bb26-f9e101301780 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.771419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.772461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.772934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.773397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.786488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:27.795665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 25 03:11:27.801802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 209/431] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:27.803434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.812404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:27.815413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:27.821640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:27.822281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:27.825134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:27.828262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:27.833425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 223/432] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:27.840542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:27.952206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3da-ab12-4220-993b-8cfebff5f69a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:27.988141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123562-c39a-46fa-84c8-d22cc096290c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.000921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.002408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.003382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.003898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.005515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.007640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.011696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 224/433] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:28.017740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.031120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.032742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.033251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.033780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.034730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:28.035234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.036826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.046079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 210/434] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:28.056009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.132596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2ab01-55b3-49a4-bb7b-f35d4a547e76 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.166875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.167749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.168273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.168678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.169616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:28.169993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d15d8-4bad-4ec3-a3cc-48601f8835d4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.170472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.171508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb31448-e328-4b76-b67c-26927e8761df None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.178348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 225/435] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:28.208535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.209124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.209403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.209706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.240302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6842eb-83a9-4924-ae30-f99dd625a7da None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.240947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6842eb-83a9-4924-ae30-f99dd625a7da None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.241414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6842eb-83a9-4924-ae30-f99dd625a7da None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.247834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 226/436] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:28.250098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.250717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.251194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.269463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:28.271053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:28.285828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.287360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f6a65-c8d9-4024-bfb1-3fdfd811a3d0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.353831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 227/437] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:28.369906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.397200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 211/438] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:28.400749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43661e0-d937-4924-9da2-f7bd616ad0e6 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.400749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43661e0-d937-4924-9da2-f7bd616ad0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.400749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43661e0-d937-4924-9da2-f7bd616ad0e6 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.401399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 212/439] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:28.402162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43661e0-d937-4924-9da2-f7bd616ad0e6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.474865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100b7ff-5518-4c87-b9b0-212ae99587cf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.501431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43661e0-d937-4924-9da2-f7bd616ad0e6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.506588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.507364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.507640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.507908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.517589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:28.524238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-07ecc848-2643-432f-a269-db8bd0a872fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:11:28.525549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 228/440] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:28.526611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666415-8620-41e9-bad2-b22202991237 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.526807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666415-8620-41e9-bad2-b22202991237 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.527082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666415-8620-41e9-bad2-b22202991237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.534043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.534906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.535183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.535451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] PATH_INFO: `/v3/projects/b06091d94fc345119033e2cdf17a8f92` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.537182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] RBAC: Authorizing `identity:get_project(project_id=b06091d94fc345119033e2cdf17a8f92)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.538654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.544901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 213/441] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/projects/b06091d94fc345119033e2cdf17a8f92 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:28.544901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.545115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-20666415-8620-41e9-bad2-b22202991237 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:28.545115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-20666415-8620-41e9-bad2-b22202991237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:28.608202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 229/442] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:28.609012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666415-8620-41e9-bad2-b22202991237 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.633630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebcbd-e43f-45ad-8b00-a94c8adb2e92 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.666773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.667434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.667716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.667991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.668734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:28.669843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.670544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.679096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 214/443] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:28.680160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.701860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666415-8620-41e9-bad2-b22202991237 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.734639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.735519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.735803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.736073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.737224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.738681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.740277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 230/444] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:28.741021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.774879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879db43-42a5-46a5-a392-c69e2f145e9e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.805999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.806790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.807073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.807358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.817625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:28.825011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:28.826223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 215/445] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:28.826972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:28.838506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c6ce-beec-4bf4-b07e-dc46388d46ec None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.870186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.870816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.871094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.871372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.920240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaa94b-9cfb-426f-acef-d443734eac73 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:28.933533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.935083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.951891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:28.952526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:28.952809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:28.953085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:28.954455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=6c92be9ce56e4845a791f4b0886eb2c0, scope.project.id=b06091d94fc345119033e2cdf17a8f92) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:28.954895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:28.956468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:28.962276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 216/446] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=b06091d94fc345119033e2cdf17a8f92&role.id=6c92be9ce56e4845a791f4b0886eb2c0 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:28.967216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.062146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 231/447] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:29.063673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.074621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90af22-1682-408b-80e9-b208f6e434af None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.110518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.111196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.111478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.111751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.112493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:29.112799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.114247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.127722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 217/448] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:29.128756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.168905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec09d-bc92-43ba-ba80-6297ab3ba493 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.204168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.205025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.205310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.205922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] PATH_INFO: `/v3/projects/b1302222fc7241c1bba468ff84d0f185` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.207974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=b1302222fc7241c1bba468ff84d0f185)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.209496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.211452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 232/449] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/projects/b1302222fc7241c1bba468ff84d0f185 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:29.216527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.234243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33226cc-bf92-4d2c-9abb-c32bd1109520 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.268139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.269051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.269337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.270114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.324653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259c4d-9aed-44fa-a423-5419fcc3bcd8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.339119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.340508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.371079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.372047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.372397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.372679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] PATH_INFO: `/v3/groups/6699b3211f5746e5adf856a8d063d437` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.373957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] RBAC: Authorizing `identity:get_group(group_id=6699b3211f5746e5adf856a8d063d437)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.375459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.377069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 233/450] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/groups/6699b3211f5746e5adf856a8d063d437 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:29.384425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.447360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 218/451] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:29.452461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.497500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2682-861d-4ca6-8586-12c7a4e8bfac None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.537270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.538101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.538384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.538660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.539979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] RBAC: Adding query filter params (group.id=6699b3211f5746e5adf856a8d063d437, role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=b1302222fc7241c1bba468ff84d0f185) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:29.540287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.541764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.548177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 234/452] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/role_assignments?group.id=6699b3211f5746e5adf856a8d063d437&scope.project.id=b1302222fc7241c1bba468ff84d0f185&role.id=36a26de00c7141a09176dacfb7236db0 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:29.564846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969f01-1d61-4df4-a0ec-5e5d72a1a5b9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.604768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.605986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.606264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.606534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] PATH_INFO: `/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.607845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe7ef74399c4347a918ab1c2dc31d8e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.609341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.611235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 219/453] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/projects/cbe7ef74399c4347a918ab1c2dc31d8e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:29.616991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.720843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438fc9-e5e2-4784-b60e-27676ed70c13 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.754067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.754908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.755243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.755514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] PATH_INFO: `/v3/groups/0e984a5ca66249d7becea490530d3cdb` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.756680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] RBAC: Authorizing `identity:get_group(group_id=0e984a5ca66249d7becea490530d3cdb)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.758135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c44bb-b82c-4c37-b186-1a6b95669fd6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.759740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 235/454] 10.222.0.24 () {56 vars in 1180 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/groups/0e984a5ca66249d7becea490530d3cdb => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:29.765477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:29.860037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e65917-54f5-4945-8b60-c02190de6952 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:29.891482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:29.892124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:29.892403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:29.892675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:29.893478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] RBAC: Adding query filter params (group.id=0e984a5ca66249d7becea490530d3cdb, role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:29.893816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:29.895254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ec33-5a55-4a67-8b48-5ce6c7ea9c89 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:29.900678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 220/455] 10.222.0.24 () {56 vars in 1376 bytes} [Fri Mar 25 03:11:29 2022] GET /identity/v3/role_assignments?group.id=0e984a5ca66249d7becea490530d3cdb&scope.project.id=cbe7ef74399c4347a918ab1c2dc31d8e&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:33.085521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aff4d-48f7-4d2c-bd6c-a9b112d09b22 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.085521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aff4d-48f7-4d2c-bd6c-a9b112d09b22 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.085521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aff4d-48f7-4d2c-bd6c-a9b112d09b22 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.085521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 236/456] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:33.090949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc69c-479d-4b1e-80ef-b628aa6b9707 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.091364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc69c-479d-4b1e-80ef-b628aa6b9707 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.091552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc69c-479d-4b1e-80ef-b628aa6b9707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.114684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6dadc69c-479d-4b1e-80ef-b628aa6b9707 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:33.115886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6dadc69c-479d-4b1e-80ef-b628aa6b9707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:33.135488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dafb-99ba-49c0-9425-aa1ebb413522 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.135785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dafb-99ba-49c0-9425-aa1ebb413522 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.136040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dafb-99ba-49c0-9425-aa1ebb413522 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.138178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 237/457] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:33.143632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.143917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.144196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.175097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:33.176469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:33.197742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 221/458] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:33.199454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ec433-8b70-4162-81a3-a91d97376729 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.199746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ec433-8b70-4162-81a3-a91d97376729 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.200023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ec433-8b70-4162-81a3-a91d97376729 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.202750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 222/459] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:33.208904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.209132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.209407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.226636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:33.227816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:33.252524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 238/460] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:33.253393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.312798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 223/461] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:33.313649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.356503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fdf5d-3e16-47e9-97bc-2864b87c67aa None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.401428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.402436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.403202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.403485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.416592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.418718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.435212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e9c5-f33f-4965-83d9-0e295c67c2fa None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.443337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:33.444561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 239/462] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:33.445333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.473172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.473911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.474194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.474466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.484100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.486121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.503366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-6a43a0e9-849d-477e-b297-7c1e2f2380bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:33.504567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 224/463] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:33.505795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fafb9-cc69-40c6-a093-b802b30bfb82 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.506080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fafb9-cc69-40c6-a093-b802b30bfb82 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.506353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fafb9-cc69-40c6-a093-b802b30bfb82 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.508151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 225/464] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:33.510164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fafb9-cc69-40c6-a093-b802b30bfb82 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.554268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dd16-5f81-42ae-8e7d-3402ebb88c24 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.592298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.593304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.593815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.594675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.604292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.605766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.611024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fafb9-cc69-40c6-a093-b802b30bfb82 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.622261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:33.623447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 240/465] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:33.624209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.650341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.651554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.652212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.652655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.653984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:33.654678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.656192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4dd57-8335-4b37-ab13-8f4cefcaa47c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.668314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 226/466] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:33.669748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.670034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.670306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.686577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:33.689222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:33.728525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b443b-5f03-4bd8-aff7-cdcae7575e41 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.758175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 227/467] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:33.759319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.775294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.775965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.776249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.776525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.777413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:33.777759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.779560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.798415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 241/468] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:33.799302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.859472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbf0ac-9917-45ef-a4be-a6ea9971a45c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.892989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.893894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.894178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.894450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.895155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:33.895454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.896825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:33.898511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040ba67-5b8c-46c7-8b2e-bd6759b7f5a3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:33.907845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 228/469] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:33.908626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:33.939465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:33.940151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:33.940433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:33.940710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:33.941403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:33.942880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.009400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541c1f-c951-45c0-bbbc-28f19e7be7fa None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.038025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 242/470] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:33 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:34.039125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.052661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.053803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.054275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.054718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.067728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.069238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.087978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:34.094500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 229/471] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:34.094500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.159874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e044-767a-4df8-bda4-00284100f85f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.196418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.197125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c37e4-f00b-45ec-8281-469c189987b1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.197264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.197426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.197702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.198437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.199909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2947e-abe6-49ab-b854-b725f3d23e9f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.231184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.231850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.232129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.232453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.233257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.235302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284c28d-c7ae-4c2d-81e0-460ea6235448 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.313233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 243/472] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:34 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:34.314587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868c8a-b930-44ee-befc-c3a804d14a2f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.314881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868c8a-b930-44ee-befc-c3a804d14a2f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.315161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868c8a-b930-44ee-befc-c3a804d14a2f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.316997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 244/473] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:34.317756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868c8a-b930-44ee-befc-c3a804d14a2f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.331301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 230/474] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:34 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:34.332723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.333013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.333291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.352346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:34.353761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:34.438322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 231/475] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:34.462087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.486659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868c8a-b930-44ee-befc-c3a804d14a2f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.543846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.544513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.544796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.545069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.545842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:34.546136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.547662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.572856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 245/476] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:34.579042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.590238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7281bc-5c92-4b1f-ab34-556aafd5f292 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.628620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.629577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.630094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.630557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.631535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.633193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.673745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.sql.core [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 25 03:11:34.673745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 25 03:11:34.673745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [parameters: {'id': 'e1917950717643229f98e809ee7c9648', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 25 03:11:34.673745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 25 03:11:34.693627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 25 03:11:34.696406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 232/477] 10.222.0.24 () {60 vars in 1131 bytes} [Fri Mar 25 03:11:34 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:34.702672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:34.703786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d42-79e7-432e-87a3-3e5d9ebd5d54 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.748643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.749790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.750711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.751191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.752449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:34.754783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:34.814197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9487-e931-42f0-97fb-790366bbbcc4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:34.846147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 246/478] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:34 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:34.856059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:34.856954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:34.857282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:34.857558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:34.868711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:34.876341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e3e24dba-206a-4851-99f6-a34d2525a4eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 25 03:11:34.878145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 233/479] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:11:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:34.886468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:35.039788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdc94f-0d90-4066-b179-696930164d4f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:35.093743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:35.093743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:35.093743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:35.093743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:35.094156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:35.094156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:35.095334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8add-ac81-495b-a568-2fe76042a0a5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:35.104583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 247/480] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:36.896418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcec1a-f4a7-4e7f-8324-63664b23ab6b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:36.896959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcec1a-f4a7-4e7f-8324-63664b23ab6b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:36.896959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcec1a-f4a7-4e7f-8324-63664b23ab6b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:36.899250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 234/481] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:36.905011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bb9d-d2ea-4063-87d5-1330633000aa None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:36.905530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bb9d-d2ea-4063-87d5-1330633000aa None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:36.905607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bb9d-d2ea-4063-87d5-1330633000aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:36.927733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9d30bb9d-d2ea-4063-87d5-1330633000aa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:36.928919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9d30bb9d-d2ea-4063-87d5-1330633000aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:37.002282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 248/482] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:37.038442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcec1a-f4a7-4e7f-8324-63664b23ab6b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.171406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcec1a-f4a7-4e7f-8324-63664b23ab6b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.214450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.215255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.215537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.215813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.226840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:37.238848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:37.240067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c5853-ea01-434d-98ed-ce5b2ba95af5 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.240379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 235/483] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:37.240493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c5853-ea01-434d-98ed-ce5b2ba95af5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.240681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c5853-ea01-434d-98ed-ce5b2ba95af5 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.246152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.246271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 249/484] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:37.251630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ea5cc-2cbd-4ae5-8a75-b29df9694539 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.251915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ea5cc-2cbd-4ae5-8a75-b29df9694539 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.252191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ea5cc-2cbd-4ae5-8a75-b29df9694539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.280678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c83ea5cc-2cbd-4ae5-8a75-b29df9694539 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:37.285017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c83ea5cc-2cbd-4ae5-8a75-b29df9694539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:37.366488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 250/485] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:37.368153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63203-cb08-4aa2-868d-a2ee90cddc8e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.368642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63203-cb08-4aa2-868d-a2ee90cddc8e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.369121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63203-cb08-4aa2-868d-a2ee90cddc8e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.371267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 251/486] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:37.376841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.377130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.377456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.391605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007261b-f69d-42b1-8328-47320b6aca9a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.403734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:37.405092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:37.427515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.428112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.428392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.428667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.429473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:37.429833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:37.431290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:37.440395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 236/487] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:37.441180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.488135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 252/488] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:37.489029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.583512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aeecf-f0dd-49c2-8033-156bdefadae8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.600739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb437e3-1ee2-42e1-8e5f-153525b24d5c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.617598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.618444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.618725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.618996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.629279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:37.636214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:37.637530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 237/489] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:37.638710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.646047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.646853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.647133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.647405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.660174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:37.662192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:37.684596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:37.686490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 253/490] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:37.687395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.769823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5a7f-6192-4de0-85dd-53432f53f896 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.801332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063c98-755e-4998-9a53-9f48772fcf67 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.812820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.813618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.814232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.814510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.827658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:37.837305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:37.837995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.838851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 238/491] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:37.839118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.839651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.839753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.840206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.841212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:37.841710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:37.843438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:37.857468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 254/492] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:37.858681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:37.944365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ccce-ccce-4234-89d9-8f94cf2a45f2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.959342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526394-4a1a-41b2-bdf6-68e50aa09624 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:37.980223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:37.980884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:37.981163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:37.981440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:37.982252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:37.982553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:37.983979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:37.993062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.001154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.001154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.001154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.001154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:38.001154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.001521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 239/493] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:38.001592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cf9f-6a2b-43de-8d0a-4eb9e4049249 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.001658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.005469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 255/494] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:38.006772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb263cc-ae8e-4ae9-b222-f9b533c9a0c1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.007098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb263cc-ae8e-4ae9-b222-f9b533c9a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.007338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb263cc-ae8e-4ae9-b222-f9b533c9a0c1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.009059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 256/495] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:38.009622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb263cc-ae8e-4ae9-b222-f9b533c9a0c1 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.124353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb263cc-ae8e-4ae9-b222-f9b533c9a0c1 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.126736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8d48-03a8-4937-ad53-1a6e01eec05b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.155883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.157274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.157555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.157863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.159629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.160414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.160696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.160970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.165047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.166526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.170614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.172117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.179177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:11:38.180318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 257/496] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.181080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.189216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e206da09-0eda-4d84-9193-beae14fc488f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:38.194754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 240/497] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.194754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5751e-f280-41f8-b44b-14cbbd150c79 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.194754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5751e-f280-41f8-b44b-14cbbd150c79 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.194754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5751e-f280-41f8-b44b-14cbbd150c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.208790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-edd5751e-f280-41f8-b44b-14cbbd150c79 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:38.210011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-edd5751e-f280-41f8-b44b-14cbbd150c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:38.274784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 241/498] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:38.275684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782f3e3-e6cd-40e3-a9ec-42c260cf412b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.276082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37b14c-2b8d-4d33-97ce-155f7b1d61db None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.276372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37b14c-2b8d-4d33-97ce-155f7b1d61db None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.276645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37b14c-2b8d-4d33-97ce-155f7b1d61db None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.278333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 242/499] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:38.279013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37b14c-2b8d-4d33-97ce-155f7b1d61db None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.312913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.313734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.314022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.314292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.324445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.325935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.342577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:38.343759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 258/500] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.344558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.374214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37b14c-2b8d-4d33-97ce-155f7b1d61db None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.406450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.407112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.407411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.407668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.408516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:38.408822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.410312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93579551-e3c5-430f-8fc8-1e1de1ac8a35 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.439486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0af8d7-15e3-4ea4-b4f5-eaec568a84ef None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.447131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 243/501] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:38.448363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.448650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.448934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.466713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:38.467937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:38.471965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.472614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.472892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.473163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.473892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:38.474193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.475548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.486796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 259/502] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:38.487470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.531630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 244/503] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:38.532441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.585495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e795-1945-4cec-9c4d-379609da5dcf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.617271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.618075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.618356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.618625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.625691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e383-8957-40f4-a284-3c133a1d759d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.628729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:38.635496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:38.636653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 260/504] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.637392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.658308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.658958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.659241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.659512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.660223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:38.660532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.661935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.673112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 245/505] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:38.673918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.738021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2789a9-638e-4500-8d36-deae7e801211 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.765913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8ab8-569b-47a2-a907-d7ac7d93ae64 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.770049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.770678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.770960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.771235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.797101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.797910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.798192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.798467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.805564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.807036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.820726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 25 03:11:38.821921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 246/506] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.822673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.835436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.836877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.919207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9da7d-3634-4262-a1e2-1503abe6dfb2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:38.931924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 261/507] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:38.932745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:38.951271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:38.952045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:38.952321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:38.952590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:38.963982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:38.987672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:38.987672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:38.987672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 247/508] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:38.987672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.027540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57114-f1fe-4e85-b92d-b690221ad0dd None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.059217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.059862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.060137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.060405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.061126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.061423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.063332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.070763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 262/509] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.071518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.079219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f4909-cbd2-4af8-94d4-9173f4f4ec03 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.110649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.111422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.111697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.111965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.119827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.121291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.134728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 25 03:11:39.136045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 248/510] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:39.136794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.167177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f278b6-616a-43cb-bcc2-61614bb7818f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.198492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.199136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.199413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.199678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.200479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.200779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.202222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.229384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115090a-b1be-4715-9f29-78a37f5424d2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.238617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 263/511] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.239413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.261641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.262452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.262737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.263012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.273627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.275117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.290991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:39.292270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 249/512] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:39.292838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.337200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8aaa-e28f-4fd4-9d18-d6f2804baac0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.368587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.369228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.369506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.369810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.370512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.370813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.372171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.383299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 264/513] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.384097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.386208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e520c6-e2f8-4149-8a54-4552e1280d79 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.417948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.418724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.419006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.419280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.429857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.431313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.447564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:39.448731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 250/514] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:39.449497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.479048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633767c0-ae53-4ec3-a3cb-aef66f06dd14 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.510646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.511292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.511576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.511846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.512648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.512951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.514404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.530443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 265/515] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.531254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.550123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463376-644f-4b18-ac21-a91098621405 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.582206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.582841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.583122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.583396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.622406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee362b-cb65-4910-b853-9ed2f43256f8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.646238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.647720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.654173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.654810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.655085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.655350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.656075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.656374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.657741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.668355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 266/516] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.669096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.740252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 251/517] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:39.741062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.761945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3f8e-7352-4e75-9721-3f155256236f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.793144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.793822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.794105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.794377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.795071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.796489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.832508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc363789-60ab-4dc2-86b8-1f9d9709a3b5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.864604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:39.865241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:39.865516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:39.865816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:39.866511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:39.866803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:39.868162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:39.877356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 267/518] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:39 2022] POST /identity/v3/users => generated 247 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:39.878296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.878984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 252/519] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:39.879620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:39.990066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33308-fba6-45a1-bc7a-a7d615e9c40b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:39.991202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9787ab-4f17-4c20-948c-02391fe4eca4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.026317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.026554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.027124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.027404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.027678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.028758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.029220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.029731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.038416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.040180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.055295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:40.056740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 253/520] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:40.059817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.106465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.107989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.165195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e2ee-9f99-4558-8917-2d709faaa042 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.197266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.198370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.198644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.198917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.209540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 268/521] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:40.209540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.210063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.211566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.228709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:40.234201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 254/522] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:40.234201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.305724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7595-1160-456d-8438-20e7e92fca10 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.332019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf175-bf54-43bd-bdf1-653083c73d7f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.338731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.339516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.339793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.340061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.348189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.349619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.363491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 25 03:11:40.369048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 269/523] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:40.369048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.370015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.370671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.370951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.371224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.371995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:40.372304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.373787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.392907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 255/524] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:40.393816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.478449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421f5d6-e7d2-4bfa-92d7-8ae9f39692b2 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.491708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad23fab-b31c-40e4-8c71-6f49f53ee01e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.513247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.514073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.514356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.514628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.524723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.526523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.526625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.527169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.527446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.527715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.528418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:40.528722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.530126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.541340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 256/525] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:40.542069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.544332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:40.545634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 270/526] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:40.547513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.641523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2e0a-3494-458a-9d89-a466c8ccff95 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.643234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e74a-37fe-4a14-bcb8-bbd1cd73baba None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.674639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.675298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.675576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.675845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.676655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:40.676768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.676958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.677328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.677612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.677916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.678420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.678731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:40.679039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.680472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.693700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 271/527] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:40.693700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.707920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 257/528] 10.222.0.24 () {56 vars in 1139 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:40.708812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.820162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885088-8aa5-48ec-98ec-f1eff6f6d6e5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.824891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743d82-3618-497a-ad6b-09786586f6c9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.857407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.858106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.858386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.858656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.859442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:40.859747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.861160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.866282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:40.867072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:40.867351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:40.867618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:40.874297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 258/529] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:40.874297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.875108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:40.876583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:40.889973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:40.892064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 272/530] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:40.892810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:40.992372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedab5-ba50-48ef-b674-75dec53b7af1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:40.992932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fba4-8e63-4d7f-bb95-b9c852401a4f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.026686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.027474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.027755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.028304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.028757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.029408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.029708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.029990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.036460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.038222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.052208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:41.054045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 273/531] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:41.055033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.106135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.107616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.155096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59652dd-9601-43e6-9911-85adfe36e1c4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.189373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.190256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.190678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.191113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.192016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:41.192460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.194049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.206431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 259/532] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:41.207332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.212361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 274/533] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:41.213318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.305583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cf388-2ca8-4a05-afd8-fd5eab87afb2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.310087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e898-176d-490d-81d2-609f308e8bdf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.339890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.340548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.340878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.341157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.341970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:41.342278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.344285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.344622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.345547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.345998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.346425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.356688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.358362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.361315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 260/534] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:41.362220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.376739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:41.378463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 275/535] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:41.379366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.461686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95d56-af7a-4704-846e-3bd1519d82b5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.477620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69402d30-a147-4ffd-ba31-5cff2a7525d5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.501529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.502655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.503001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.503276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.504407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=556b5d7a961746acb131a732b62940e5) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:41.504716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.506746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.519591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 261/536] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/role_assignments?user.id=556b5d7a961746acb131a732b62940e5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:41.519591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.525709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.526436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.526726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.527006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.527841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=d5e6d8163f1d4451af656c267e6b32c3) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:41.528156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.529624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.536733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 276/537] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/role_assignments?user.id=d5e6d8163f1d4451af656c267e6b32c3&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:41.671668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c343d33-5593-4822-83b5-87cca935cc8a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.727551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.728170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.728457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.728737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.729473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:41.729817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.731267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.745401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 262/538] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:41.751509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:41.884044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4ea1-2b2b-4388-9d92-225dda44f88a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:41.925181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:41.926001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:41.926283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:41.926558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:41.933603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:41.935085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:41.952541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:41.960071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 277/539] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:41.966765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:42.115010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75173-d879-4fc1-9587-98ffd3d468f7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:42.167685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:42.168350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:42.168633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:42.168909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:42.169690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:42.170012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:42.171482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784ad31-d85d-4f6f-8531-2fbbd0368f2b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:42.188627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 263/540] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:42.194765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:42.309623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d238f9-38ca-488e-81a0-e13798a7f70b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:42.349051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:42.349722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:42.350007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:42.350279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:42.351094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f2d4c142d5db423b868edceab8bdd019) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:42.351403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:42.352828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973e756-7729-43a7-9191-c0664a5ff356 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:42.358694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 278/541] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:42 2022] GET /identity/v3/role_assignments?user.id=f2d4c142d5db423b868edceab8bdd019&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:42.459684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c85e6-471b-497d-980f-592f80d39897 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:42.459977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c85e6-471b-497d-980f-592f80d39897 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:42.460174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c85e6-471b-497d-980f-592f80d39897 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:42.462321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 264/542] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:42.467741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:42.468037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:42.468329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:42.487123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:42.488334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:42.575551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 279/543] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:42.621675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c85e6-471b-497d-980f-592f80d39897 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:42.757190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c85e6-471b-497d-980f-592f80d39897 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:42.801979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:42.802778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:42.803062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:42.803339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:42.816566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:42.823658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:42.824862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 265/544] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:42.834755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:42.976935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b2fa-9f6e-4624-b5c4-ed8fba4c4ac6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.033556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.034188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.034470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.034897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.035661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:43.035966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:43.037909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f922e4-c9e2-40d4-ad50-53abfa107ad5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:43.050499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 280/545] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:43.056294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.188058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e184625-b24b-44e9-9845-ee2a138ee0b5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.225443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df970df-ee3c-41e4-9a72-dd544e848c52 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.225959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df970df-ee3c-41e4-9a72-dd544e848c52 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.226034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df970df-ee3c-41e4-9a72-dd544e848c52 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.227984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 281/546] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:43.232804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.233091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.233360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.234868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.235661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.236040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.236316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.259700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:43.261196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:43.262498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:43.263681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:43.290565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:43.291692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 266/547] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:43.299173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.417321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 282/548] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:43.426229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233886ba-4023-442a-9f0d-ac8a66b8fc9a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.447805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.468851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.469518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.469826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.470101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.470873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:43.471179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:43.472564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:43.501292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 267/549] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:43.502583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.613029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a167e6-b78e-4087-96ee-d56d5e6382a8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.646290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dbc4b-6543-4492-91fc-c5674f284e19 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.657105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.657938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.659959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.660243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.675089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:43.677330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:43.694017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:11:43.699759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 268/550] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:43.700965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.705985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.706791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.707073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.707401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.729556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:43.745924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:43.747499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 283/551] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:43.753634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.810045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83df4-74b3-4328-876f-96a6de1c90b0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:43.853026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:43.853721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:43.854003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:43.856016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:43.856848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:43.857155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:43.862064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:43.896055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 269/552] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:43.898831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:43.942470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875a26-f8ed-4c06-9a3f-1030abac0d33 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.000392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.001052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.001329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.001597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.002358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:44.002657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.004093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.017224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 284/553] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:44.032907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.057987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbfa9e-da18-4709-aa78-7ee260645949 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.092428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.093068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.094022 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.094311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.163161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.164570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.261624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39bc3c-3348-4270-bcd1-a30a18765a04 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.268137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 270/554] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:44.278628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.305246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.306068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.306346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.306614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.322510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.323985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.345782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-5290bc93-0ce2-45c0-870e-f49789dca12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:44.347568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 285/555] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:44.348968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc663-30d5-4644-a162-18849153a0f5 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.349472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc663-30d5-4644-a162-18849153a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.349997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc663-30d5-4644-a162-18849153a0f5 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.355861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 286/556] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:44.363815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cc663-30d5-4644-a162-18849153a0f5 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.406496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7c05-8843-49a9-8bb9-2843e3a6ed4e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.441458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.442184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.442631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.443049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.456802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.458595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.476580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-643fc27e-c7f2-434e-aadc-3fc9f217e800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:44.478456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 271/557] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:44.478856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cc663-30d5-4644-a162-18849153a0f5 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.480022 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.480481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.480954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.498595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:44.500062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:44.518856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.519521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.519801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.520073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.520792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:44.521096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.523225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.539403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 287/558] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:44.540248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.571027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 272/559] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:44.572170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.674225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a7c8-ed8b-4886-b43a-d9b6ef0acf70 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.680665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97cf15-7730-4172-8b9d-31e42ec32ae5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.707619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.708209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.708492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.708771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.709515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:44.709861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.711243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.720024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.720880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.721166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.721441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.723233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 288/560] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:44.724023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.734002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.736390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.755840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-0fb32dec-1704-4df0-a39b-2a6f8ddedc29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:11:44.761058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 273/561] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:44.762589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f26b-4852-43d8-8a10-5272ce7addfd None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.762965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f26b-4852-43d8-8a10-5272ce7addfd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.763507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f26b-4852-43d8-8a10-5272ce7addfd None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.765940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 274/562] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:44.766608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f26b-4852-43d8-8a10-5272ce7addfd None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.834396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1fd9-e76c-404a-92d5-35d45c4df131 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.866779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.867554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.867837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.868106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.868916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f26b-4852-43d8-8a10-5272ce7addfd None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:44.877814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:44.884538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:44.891540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 289/563] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:44.891540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:44.904021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:44.904806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.905088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.905360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.913247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:44.914754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:44.928521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-d433e0b8-8d95-4b3f-b65d-88303e5182f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:44.933999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 275/564] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:44.935774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:44.936135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:44.936411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:44.954269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:44.955988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:44.996829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bcb53-338e-4e64-9db8-89d8a9bf852b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.031281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.031948 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.032228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.032495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.033315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.033619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.035094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.037804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 276/565] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:45.038769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.062026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 290/566] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.063125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.139880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefb55d-f0e8-4f31-b6b7-7c71ef6d7595 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.159840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ea5f7-5003-4945-aad9-5da1a2fb1aaa None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.172354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.173003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.173273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.173536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.174287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.174583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.175963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.183422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 277/567] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.184175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.192617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.193263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.193541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.193851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.194621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.194924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.196337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.207582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 291/568] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.208201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.276425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f67f-49b9-4eb0-b751-896a2522f004 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.300396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09741857-ee19-45e9-b463-b95bfcd79d29 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.307753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.308528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.308807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.309075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.318602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:45.325350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-7bcd6df9-5634-4898-96eb-eaf7bffa9e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:45.326519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 278/569] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:45.328309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ad2a-cfd3-42b8-92e0-c435f41652b6 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.328595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ad2a-cfd3-42b8-92e0-c435f41652b6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.328860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ad2a-cfd3-42b8-92e0-c435f41652b6 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.332715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.333516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.333910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 279/570] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:45.334013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.334100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.334648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0ad2a-cfd3-42b8-92e0-c435f41652b6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.345050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.346515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.361973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:45.363109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 292/571] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:45.363853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.433943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0ad2a-cfd3-42b8-92e0-c435f41652b6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.456161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425672ac-ce01-46b4-a9c8-e4ecae6e4782 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.465198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.465998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.466271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.466543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.476925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.478390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.487571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.488196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.488476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.488750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.489553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f5956fc6e9b848298d2623b191e841c9) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.489892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.491331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4bf66-7dbe-44c4-9904-3014de6bdb16 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.494113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:45.495262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 280/572] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:45.496002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.505722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 293/573] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/role_assignments?user.id=f5956fc6e9b848298d2623b191e841c9&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.505722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.505722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.505722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.515766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:45.517012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:45.588383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 294/574] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:45.589572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.626371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53df3f-2214-4500-91b9-9bbfde571375 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.663519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.664231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.664511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.664785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.665530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.665856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.667260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.680231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 281/575] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.680231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.702239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1458d-b455-466a-a763-9f32f9a853d7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.738726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.739386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.739665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.739937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.740660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.740966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.742363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.758582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 295/576] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.758582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.779162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c93cf-948c-43e2-8755-ffc1cc4a1b5c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.812671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.813332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.813613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.813927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.814664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:45.814965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.816354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:45.828123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 282/577] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:45.828988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.865721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83e9b-d32b-4772-86a9-170052611b58 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.897972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.898763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.899047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.899346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.909851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:45.916768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:45.923111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 296/578] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:45.923111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:45.929861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ad05-94e7-418b-984f-3d66d71bd3b7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:45.968675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:45.969545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:45.969858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:45.977154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:45.983640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:45.985692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.002039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:46.007596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 283/579] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.007596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.020151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3ba2-7c41-4b10-8204-09f1c2a64b34 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.052762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.053541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.053855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.054133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.060572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.062083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.075027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:46.081550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 297/580] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.081550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.103359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51b54-18cd-4592-8ac7-39cf335c2ebf None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.135568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.136283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.136564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.136836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.144403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.145891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.160988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 25 03:11:46.162201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 284/581] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.162958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.182588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70bcd-73f0-4cbc-bd10-eecae8fc8de9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.215822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.216625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.217012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.217289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.218061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.218965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.220333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.228151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 298/582] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:46.229041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.265916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43833d-3b90-47d4-97b3-2ca27c69d743 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.302251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.302901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.303173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.303440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.304250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.304437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.305871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.321133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 285/583] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:46.321133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.324419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d22a-ea78-4891-8921-c0c724175959 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.357491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.358168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.358443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.358709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.360053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.360357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.361831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.379119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 299/584] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:46.379777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.418687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e7c7e-3133-4126-b418-a91e29e9ee0c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.451252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.451918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.452198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.452472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.453342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.453645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.455120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.477433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 286/585] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:46.477433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.478860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3db07b-315d-4ec3-a2c8-63033f891f58 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.514662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.515890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.516835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.517321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.530592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.532569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.550028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:46.553999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 300/586] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.555178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.574091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62fa5-2ac9-419e-81d9-da1d08c67540 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.606854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.607665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.607946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.608226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.616750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.618430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.632703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 25 03:11:46.638400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 287/587] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.638400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.659367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a25b60-0228-47f6-bb44-b018903141e4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.693109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.693948 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.694224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.694492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.709030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=ba728b1294014f94b7acab7ccf594ce7, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.710846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.730853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ea924-51a8-48ba-82a9-dc28802b2975 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.763704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.764482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.764764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.765039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.774731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.776187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.801699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 301/588] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:46 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:46.801699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.802004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:46.802004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 288/589] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:46.802004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.911817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ad39-8a5d-4e98-af7b-bc341961c3fc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.935933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb9e0-0684-40a9-a771-07577f2e52e8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:46.950682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.951515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.951899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.952296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.957320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.957320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.957320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:46.977371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 289/590] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:46.978626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:46.986024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:46.986714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:46.986994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:46.987281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:46.988016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:46.988321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:46.989753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.006533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 302/591] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:47.007498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.097754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff30a6-db22-4e42-b817-6ac3ed44e212 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.117280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0ebd-e384-408a-b53f-3bdc2d4b6bf1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.134059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.134723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.135003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.135281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.135997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:47.136297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.137724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.151209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.151994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.152276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.152546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.153789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 290/592] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:47.154660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.163501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.165013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.181807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:47.183288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 303/593] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:47.184064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.261701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b910d2-2cd9-4931-b823-039f83dee7da None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.285480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c98f-2cd8-4815-b9cf-0df531714b75 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.297224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.298057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.298386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.298667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.306493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.307947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.318888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.319664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.319941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.320209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.321517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 25 03:11:47.323100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 291/594] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:47.324055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.326927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.328419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.342675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:47.349142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 304/595] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:47.349832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.426521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b61d8d-dc2a-4126-b733-e5316b4d8736 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.447719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765cfa-1628-4d1c-9911-112bfce99cc0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.462724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.463401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.463735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.464016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.464747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:47.465049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.466554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.480233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 292/596] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:47.486136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.486486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.487306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.487588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.487858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.488685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:47.488986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.490449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.507990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 305/597] 10.222.0.24 () {56 vars in 1139 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:47.508891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.589347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5655e8-995b-4619-8ceb-09f9cf6ba598 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.609119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ddab-d47d-40e0-84bf-ade651471c99 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.623987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.624710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.624996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.625275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.626081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:47.626386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.627949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.640447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 293/598] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:47.641121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.647790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.648576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.648857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.649130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.656892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.658367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.671565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:47.673060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 306/599] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:47.673857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.748599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a432ac-6583-4825-baf0-5ad4aec4a96c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.773374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91093c90-3f52-4acd-bd87-d4901f2c6522 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.783672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.784460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.784747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.785017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.796007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.797602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.806365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.807242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.807516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.807786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/556b5d7a961746acb131a732b62940e5/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.817506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:47.819618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 294/600] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:47.820839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.821969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=556b5d7a961746acb131a732b62940e5, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.823478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:47.895266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 307/601] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:47 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/556b5d7a961746acb131a732b62940e5/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:47.896469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:47.942810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fdd5-568a-4b2c-be44-b1a69e9c1353 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:47.985569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:47.986349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:47.990036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:47.990036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:47.990036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:47.990036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:47.990036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ef2e0-6f24-43df-b86e-b0ca678fb68a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.003985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 295/602] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:48.010263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb884b-907b-46b1-aeb3-37d1dec3b1b9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.010534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada8d3-d53d-483f-8fa3-c0996c321477 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.010798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada8d3-d53d-483f-8fa3-c0996c321477 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.011075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada8d3-d53d-483f-8fa3-c0996c321477 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.013905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 296/603] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:48.015795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada8d3-d53d-483f-8fa3-c0996c321477 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.049041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.049851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.050138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.050418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.051196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:48.051500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.053026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1b89-5b52-4b5c-a4cc-e99773b379f9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.069755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 308/604] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:48.069755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.069755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.069755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.088879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:48.090297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:48.127942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada8d3-d53d-483f-8fa3-c0996c321477 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.163387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 309/605] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:48.164770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.172092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.172986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.173261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.173527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/d5e6d8163f1d4451af656c267e6b32c3/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.204071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=d5e6d8163f1d4451af656c267e6b32c3, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.206298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.276236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a43ab-d5eb-4294-a99f-9779d8d491d2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.296077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 297/606] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:48 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/d5e6d8163f1d4451af656c267e6b32c3/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:48.296077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.357993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.359475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.359756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.360027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.377454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.381033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.406723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:48.409630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 310/607] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:48.413641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.522489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189a146-e1fe-4a9b-9ac3-3c33615ecfb0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.529122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44948d93-c504-44a3-b519-61a6f345a284 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.564704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.565363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.565647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.565951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.566724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:48.567039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.568573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.572120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.573160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.573656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.574160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.585703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 311/608] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:48.587857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:48.588641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.597009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:48.598538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 298/609] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:48.604181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.719963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7acb-7992-4a4e-9900-61eade4cccc8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.726164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211518-51f8-4290-ae98-709e14237db0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.769454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.770167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.770452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.770727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.771710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:48.773695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.773695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.784217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 299/610] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:48.790066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:48.810401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.811294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.811568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.811870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f2d4c142d5db423b868edceab8bdd019/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.843545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=f2d4c142d5db423b868edceab8bdd019, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.844999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.896730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13863-5b12-4b37-9583-50ad7d3cd439 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:48.933680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 312/611] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:48 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f2d4c142d5db423b868edceab8bdd019/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:11:48.935777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:48.936652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:48.937063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:48.937388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:48.951857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:48.953452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:48.972232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:48.977920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 300/612] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:48.979572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.107834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d3ac-96ef-45ca-b996-a51e622edabe None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.156696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.157383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.157681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.157964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.158777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:49.159090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:49.160504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e9f2-73c5-4321-80f8-6b8a9a4e18e6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:49.173967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 313/613] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:49.179302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.284063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57ebde-ad02-4b43-bbe9-d5642b01eade None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.318692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.319548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.319830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.320103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.325358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a93a-3411-49d6-b249-2f64d31bafa6 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.325642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a93a-3411-49d6-b249-2f64d31bafa6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.325953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a93a-3411-49d6-b249-2f64d31bafa6 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.328313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:49.328999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 314/614] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:49.329808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:49.333172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928377-b85f-43f7-9911-19a49427229b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.333457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928377-b85f-43f7-9911-19a49427229b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.333770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928377-b85f-43f7-9911-19a49427229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.344037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:11:49.345487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 301/615] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:49.350906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.351481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-16928377-b85f-43f7-9911-19a49427229b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:49.352646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-16928377-b85f-43f7-9911-19a49427229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:49.453502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06e054-8a6d-4039-a72c-d1570b60bd06 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.488861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.489534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.489853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.490128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.490954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:49.491259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:49.497686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:49.499246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 315/616] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:49.510552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 302/617] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:49.515883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928377-b85f-43f7-9911-19a49427229b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.535666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.630053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928377-b85f-43f7-9911-19a49427229b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.635222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151668e-5844-4910-a831-5f19bb14045c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.664851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.666047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.666529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.667078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.669934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.670719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.670998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.671903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.681900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:49.683363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:49.697513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:49.704481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:49.706145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 303/618] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:49.713404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:49.714730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 316/619] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:49.715518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.722766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.843093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28bb3-19ca-4d67-b826-d72bd547b838 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:49.882436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:49.883112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:49.883392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:49.883667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:49.884408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:49.884709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:49.886231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:49.895765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 304/620] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:49.901123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:49.937434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a371d-e0cd-4071-b4b3-157dea186adf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.005881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cc2e-36cd-4cb9-a24b-29be48eaea02 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.035024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.035689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.035968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.036237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.037017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:50.037318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.038720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.041378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.042205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.042488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.042761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.054103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.055640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.061181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 317/621] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:50.068333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.078714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:50.080266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 305/622] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:50.085768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.191749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a37ed-ee52-437b-a83c-641b24bc9e6f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.230355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.231379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.232700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.233186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.235563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:50.236862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.239813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.261730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 306/623] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:50.268733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.308520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851a41-52b0-4994-bfcb-3c1e8e6182db None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.389642 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ca76-803d-46c2-a716-78c1d9bc2f1f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.395730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.396524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.396806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.397080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.414776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.416245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.426775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.427864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.428345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.428834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.437209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.439016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.449581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:50.456326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 318/624] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:50.458137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:11:50.458553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.459594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 307/625] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:50.464856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.585882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3629d-3b9e-4652-a1ef-1acbf1f12d3e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.618982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b8eb-0ce2-4dd5-af99-c33e48f7aa11 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.619788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.620455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.620734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.621007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.621896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:50.622335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.624938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012a8bd-c5a2-470a-9b02-e0c57b47b1e3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.651293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 308/626] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:50.651293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de45a7-a111-4d70-8a33-0453faccb055 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.651293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de45a7-a111-4d70-8a33-0453faccb055 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.651293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de45a7-a111-4d70-8a33-0453faccb055 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.651293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 309/627] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:50.652469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de45a7-a111-4d70-8a33-0453faccb055 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.666149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.667149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.667430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.668007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.669063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:50.669370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.671404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d4654-4146-48f7-a6f6-2137824b573c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.686369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 319/628] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:50.688166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.688717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.689058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.710021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:50.711147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:50.768167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de45a7-a111-4d70-8a33-0453faccb055 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.797909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 320/629] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:50.798777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.807638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.808279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.808557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.808828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.875752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.877525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:50.916347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f78c-38ac-4a57-99ff-e059815ec528 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:50.954120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:50.955121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:50.955404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:50.955981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f5956fc6e9b848298d2623b191e841c9/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:50.979212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 310/630] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:50.980156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:50.980465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=f5956fc6e9b848298d2623b191e841c9, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:50.982003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.074910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc140ca-be38-4a1a-a750-f7f0d592e860 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.107683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.108468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.109288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.109556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.119506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:51.126573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:51.132490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 311/631] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:51.132490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.150419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 321/632] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:11:50 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f5956fc6e9b848298d2623b191e841c9/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:11:51.156741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.303513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f8c6e-f779-4d0a-ae51-231ff590a66f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.339510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.340627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.341111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.341552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.342338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2eca-b698-4c23-84ad-07c0695b4cc2 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.360148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.361989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.385867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9e979805-64e7-4a6c-8b6e-8c5d8ec07bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:51.386465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.388032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 312/633] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:51.388257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.388700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d229-9f14-42b5-ad0d-070cad65e818 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.388935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.389031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d229-9f14-42b5-ad0d-070cad65e818 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.389243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d229-9f14-42b5-ad0d-070cad65e818 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.389707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.390791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:51.391313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.392899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c4a63-8efb-456d-9abf-f8ef486f8430 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.395495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 313/634] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:51.397097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d229-9f14-42b5-ad0d-070cad65e818 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.403903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 322/635] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:51.405302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.405623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.405934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.423456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:51.424867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:51.504207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 323/636] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:51.505061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.531405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d229-9f14-42b5-ad0d-070cad65e818 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.567259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.567839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.568169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.568441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.569193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:51.569495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.571030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.584754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 314/637] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:51.585650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.625693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdad6e-7fde-44f0-a9c0-e9e9b8fa05cf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.660628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.661419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.661725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.662004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.672280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.673765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.684483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a9fb-57af-434e-ba71-e3d480c11aad None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.694739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:51.697753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 324/638] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:51.698608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.735754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.736549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.736827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.737095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.747584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:51.755053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:51.756501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 315/639] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:51.757263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.800216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f024cc-75b1-4c58-b32e-67bb2847af81 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.841583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.842451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.842739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.843525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.852690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.854540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.855177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a59c4-9b12-4556-a151-0ba3487c0ed8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:51.868683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-48c04895-bdfc-4d2a-89ce-db73c9e177b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 325/640] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e783f-d025-4430-9bfa-be215849b303 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e783f-d025-4430-9bfa-be215849b303 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e783f-d025-4430-9bfa-be215849b303 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 326/641] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:51.874740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e783f-d025-4430-9bfa-be215849b303 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.894094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:51.894746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:51.895023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:51.895293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:51.896000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:51.896296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:51.897698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:51.915736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 316/642] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:51.915736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:51.993829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e783f-d025-4430-9bfa-be215849b303 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.018727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e319475-e180-4028-8674-f77d46147fa4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.026438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.027092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.027369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.028832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.028832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.028832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.030138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57860aa-9efe-4c0c-9534-50b6b7b6190e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.038956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 327/643] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.040176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.040461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.040735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.056938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.057552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:52.057703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.057893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.058164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.058776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:52.058923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.059277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.060709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.072809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 317/644] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.073778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.131131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 328/645] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:52.131887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.186967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47ce5-5934-4426-a7c9-642c03c2aafd None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.220513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.221295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.221571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.221871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.228092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde845b-c7ea-4b3c-b32e-293d0ff737d0 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.229282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.230844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.244359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 25 03:11:52.250478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 318/646] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:52.250478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.264759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.265546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.265870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.266139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.276339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.277806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.294561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:52.300494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 329/647] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:52.300494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.350790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9dbca-4035-4ed7-a2f9-7d2519311724 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.384305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.384898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.385163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.385436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.386298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.386607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.388109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.394966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 319/648] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.395770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.420120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af253b3-5aa2-452b-b78e-740d9d657ded None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.461055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.462248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.462695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.463124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.475023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:52.482681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:52.484225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 330/649] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:52.485227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.521282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d1d-660d-412b-86ff-fcb1c450d566 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.559349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.560502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.561032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.561516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.563206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.563724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.565561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.585460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 320/650] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.586634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.615604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a06a4-a406-41f3-a5e1-5e4d53129347 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.659046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.659671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.660146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.660252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.661010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.661267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.662665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.677417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 331/651] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.678633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.718082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40f4a-5d1d-4809-86fa-e4ff147e141a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.751793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.752463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.752741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.753011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.753762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:52.754062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.755433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.768239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 321/652] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:52.769129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:52.801005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152b8e-cbdc-4a94-b71a-94a819e32ed8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.841818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.842719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.843641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.843915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.885762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb78ace-1043-44e7-bfb9-915bada4be31 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:52.923231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.924788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.925311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:52.926211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:52.926714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:52.927054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] PATH_INFO: `/v3/users/glance` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:52.936221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:52.938394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:52.953866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 25 03:11:52.958487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 322/653] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:52.959361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.045045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 332/654] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:53.046010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.069762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3b05-5781-41de-af0f-14ce128c8b7e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.110034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.111415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.111696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.111967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.125583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.127090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.148573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:53.153738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 323/655] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:53.154554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.157586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc732-5d08-4ed1-8877-38ca18c653fa None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.201965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.203327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.203623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.203899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.205384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:53.205988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.207901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.232255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 333/656] 10.222.0.24 () {56 vars in 1137 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:53.233232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.272192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e002e4-00ce-44a7-afaf-718ecbdbc60b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.315883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.317178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.317588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.317903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.333417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.334906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67db74-21cd-4943-8517-f67713d27c94 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.335092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.361308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:53.363506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 324/657] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:53.364426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.375018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.375680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.375962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.376661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.377393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:53.377727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.379495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.395243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 334/658] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:53.396162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.472740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bda47-ae1c-4ab8-9d2c-a7fff95832fd None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.513817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.514454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.514765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.515045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.515705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c772-21f2-45dc-847b-b76571349196 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.550440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.551206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.551549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.551886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.552757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:53.553139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.554627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.571655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 335/659] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:53.572644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.597804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.599269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.677330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe451-fc6d-4f7c-b063-eb55ad92c4ee None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.702030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 325/660] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:53.703775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.711519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.712327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.712609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.712885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.720542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.722059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.735601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ad1d5735-aaa2-44c6-a44a-90beedd54241 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 25 03:11:53.736719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 336/661] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:53.738045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2f17-abba-4fd3-882a-d5ba47baa2d7 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.738338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2f17-abba-4fd3-882a-d5ba47baa2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.738615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2f17-abba-4fd3-882a-d5ba47baa2d7 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.741883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 337/662] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:53.741883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec2f17-abba-4fd3-882a-d5ba47baa2d7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.810409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24bd6-a46a-434f-afd6-6d525950bf7d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.838497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec2f17-abba-4fd3-882a-d5ba47baa2d7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:53.842553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.843869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.844146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.844413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.850831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.852280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.864777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:53.865965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 326/663] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:53.870871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:53.871184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:53.871647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.871926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.872191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.882805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:53.884257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:53.900788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-28329902-8bb6-4680-b2be-57b094e655a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:53.902230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 338/664] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:53.903483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:53.903768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:53.904036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:53.920516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:53.921745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:53.982910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a9a18-dc48-42c7-8893-26e95a823dd3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.001757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 339/665] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:54.001757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.030517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.031209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.031492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.031769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.032611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.033461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.034433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.058285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 327/666] 10.222.0.24 () {56 vars in 1139 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.058285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.102806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1162ea-d666-4f78-a633-3ece9bb3bbab None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.137411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.138093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.138371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.138640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.139415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.140347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.141820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.152945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 340/667] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.153766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.169016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d936-e985-4337-96d3-c87edb2e37a2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.202812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.203463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.203743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.204009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.204709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.205006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.206654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.219658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 328/668] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.220470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.257719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae057-ff61-4ae4-adad-3b606dae8fa5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.291892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.292678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.292957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.293225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.303803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:54.310702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:11:54.312171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 341/669] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:54.316935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.322193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc695-1778-407d-9412-c88c8d44073f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.355897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.356541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.356820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.357094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.414983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e3757-96ba-4c71-8c53-64f3d039ca87 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.427893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.429359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.448894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.449542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.449839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.450119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.450925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=556b5d7a961746acb131a732b62940e5) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.451228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.453289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.459595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 342/670] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/role_assignments?user.id=556b5d7a961746acb131a732b62940e5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.460235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.559911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 329/671] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:54.561218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.604724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03e1bd-77b3-4723-90a8-bd0cbe40779f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.652174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.653710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.654340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.654880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.663092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.664715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.672849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a62fd-c9e8-4170-9350-496ad30a7313 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.678828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:54.680557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 343/672] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:54.681458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.720191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.720960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.721153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.721395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.722380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.722557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.723888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.735213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 330/673] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.736581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.800054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f594e-b3d3-4c20-935f-8751f424cf23 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.844278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.845081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.845366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.845639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.854450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2237-d1f7-4a49-90fc-be3ba53db67b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:54.855770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.857230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.874336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:54.875792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 344/674] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:54.876725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.891696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:54.892349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.892626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.892895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.893680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:54.893992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:54.895430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310237e7-d24a-4a00-bb27-e2c59cb215e6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 331/675] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68b08b-5904-4387-887f-928dc1d96773 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68b08b-5904-4387-887f-928dc1d96773 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68b08b-5904-4387-887f-928dc1d96773 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 332/676] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:54.912571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68b08b-5904-4387-887f-928dc1d96773 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:54.985573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1d858-402d-491c-abe2-b7a7f3a6d39b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.019378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68b08b-5904-4387-887f-928dc1d96773 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.020440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.021216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.021499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.021792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.032083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.033522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.050205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:55.051363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 345/677] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:55.052117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.057847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.058503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.058785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.059056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.059797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.060068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.061472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b174-1bf4-49fd-a935-7544cbd53fe6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.073341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 333/678] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.079308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.079597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.079872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.099740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:55.100946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:55.161152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a102-c9f6-47ea-876b-4aea74534839 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.173695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 334/679] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:55.173695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.194426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.195079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.195363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.195635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.196446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=d5e6d8163f1d4451af656c267e6b32c3) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.196753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.198236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.204694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 346/680] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/role_assignments?user.id=d5e6d8163f1d4451af656c267e6b32c3&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.206610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.282659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6b172-f8cd-4602-8a57-e4bfd11ef813 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.315782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d54e-943c-438c-b428-4e91e9613a16 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.320102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.321115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.321598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.322099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.323041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.323627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.325302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.343690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 335/681] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.343690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.360649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.361902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.362387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.362860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.370659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.372467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.387120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:55.388973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 347/682] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:55.390105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.468410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea067a0-3377-4d8e-987a-1b4ca41ae9df None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.507880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.508716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.508999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.509279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.513348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19349b-fdb8-431b-8ae5-f9617a523a09 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.519874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:11:55.526814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:11:55.533329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 336/683] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:55.534225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.552751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.553856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.554142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.554414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] PATH_INFO: `/v3/users/swift` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.564388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.566609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.583602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:11:55.585582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 348/684] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:55.591593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.641155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9311d4-e597-4bfe-b1f5-b118b0949b25 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.678760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.679430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.679713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.679991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.680775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.681081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.682615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.695591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 337/685] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.696486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.716346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52476c-2e36-4dbc-b9a4-9c33da824aac None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.762110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.762793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.763077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.763352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.764149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.764455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.765875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.778435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 349/686] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.779304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.807992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01528d7-5de1-4e6c-a337-cb584186e62b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.850773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.851438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.851722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.851998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.852814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.853120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.855003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.879019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f171-0b98-480c-96b0-2a513ea19da9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:55.881892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 338/687] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.883559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.926106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:55.926963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:55.927248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:55.927523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:55.928498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f2d4c142d5db423b868edceab8bdd019) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:55.929149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:55.930889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:55.938549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 350/688] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/role_assignments?user.id=f2d4c142d5db423b868edceab8bdd019&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:55.939697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:55.993989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1263d2-2694-4c04-ad7d-6fdbd4dec129 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.030398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.031659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.032196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.032690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.044468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.046855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.066490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:56.072368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9e26c-0903-421e-b6bb-bfbfae9b5eed None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.072775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 339/689] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:56.074533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.113156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.114561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.115281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.115983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.190487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.192431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.199176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4295600-7c70-419e-8754-359550e725c4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.237958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.238628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.238910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.239181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.239894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:56.240194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.241893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.254149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 340/690] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:56.261689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.334612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 351/691] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:11:56.343219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.387246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd8c6e-3fca-4e79-a37c-3da1928ef12d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.421700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.422522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.422802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.423075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.430948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.432418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.442612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487e5e-3577-4e1c-86d9-a03642b52882 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.448977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:11:56.450497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 341/692] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:56.457538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.482226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.483018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.483351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.484127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.495491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.496974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.515448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:56.517057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 352/693] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:56.522505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.570564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca71f-265f-43ba-90cf-f4eb7a986726 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.607154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.607922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.608296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.608649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.609554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:56.609986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.611569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.632087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 342/694] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:56.639018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.647607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1befb-ea9f-41b3-82ea-da38bba970d3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.689296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.690475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.690754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.691025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.691749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:56.692407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.694569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.709629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 353/695] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:56.714462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.771705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1cbc7-8e3a-449c-8e7f-4ff235140f45 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.845746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.846773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.847264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.847719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.855681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967a9d-267e-4c2b-826a-256c07179f81 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:56.912047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:56.914852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:56.915359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:56.918258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:56.930073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.931744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:56.955074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:56.957793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 354/696] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:56.967390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:56.978775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:56.980282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7e242-ebbb-4721-a7b2-f2a0f74754a1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.073588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7b59-7256-4f80-ab25-68a908d3b50d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.082099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 343/697] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 25 03:11:57.083152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b070f7-9a8d-4fc5-b56e-bab12bf9f48d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.083438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b070f7-9a8d-4fc5-b56e-bab12bf9f48d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.083711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b070f7-9a8d-4fc5-b56e-bab12bf9f48d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.089369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 344/698] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:57.090165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b070f7-9a8d-4fc5-b56e-bab12bf9f48d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.109991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.110934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.111392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.111860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.112848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:57.113329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.114958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e61f-16e5-40e3-ac3a-e8676cd505f3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.127912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 355/699] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:57.129403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.129896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.130346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.148040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:57.149545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:57.202055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b070f7-9a8d-4fc5-b56e-bab12bf9f48d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.218783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 356/700] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:57.219906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.258065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.259180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.259796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.260246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.272436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.274790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.298233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:57.300668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 345/701] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:57.301864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.333442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed9db-0187-43ad-b5c0-4372c2633b54 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.368112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.368952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.369330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.369723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.370703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f5956fc6e9b848298d2623b191e841c9) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:57.371108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.372843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.379502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 357/702] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/role_assignments?user.id=f5956fc6e9b848298d2623b191e841c9&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:57.386821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.426950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98d69-e454-44f6-b72d-a2418709183a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.478388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.479146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.479425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.479699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.480360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.481847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.506330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 25 03:11:57.513646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 346/703] 10.222.0.24 () {56 vars in 1129 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:57.523983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.572073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4832ab-4516-431c-946c-29018b78be47 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.622399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.623071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.623349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.623616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.624370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:57.624669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.626068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.648365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 358/704] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:57.654167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.669999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78d0d-72b8-4800-97e4-fd57c026e0d5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.711411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.712139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.712418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.712692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.713425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:57.713768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.715160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.722130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 347/705] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:57.728793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.786286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522efa2-c377-49e8-960e-338a0f71609b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.820768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.821554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.821863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.822138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.829458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.831280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.848048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:11:57.849477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 359/706] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:11:57.851287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03ff6-f8f5-44ea-b991-d2b45e288e55 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.854730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:57.894619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:57.895289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.895997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.896269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.896972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:57.897273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:57.899048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5c10-5152-486c-869a-6a5e7349846a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:57.909709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 348/707] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:57.976932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c465e-e445-4860-a486-c98b2723675a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:57.989459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8d7e-430b-4e8f-9eb3-a53e680f9a25 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.989999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8d7e-430b-4e8f-9eb3-a53e680f9a25 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.989999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8d7e-430b-4e8f-9eb3-a53e680f9a25 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:57.991964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 349/708] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:11:57.997732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:57.998348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:57.998846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.016706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:58.018579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:58.020397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:58.021065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:58.021345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:58.021936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.023668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:58.023989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:58.025481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:58.045729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 360/709] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:11:58.050729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:58.110937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 350/710] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:11:58.148008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:58.156201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26de5e-5e35-4758-9486-dc2ac3fdb507 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:58.192486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:58.193042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:58.193322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:58.193598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.194447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:58.194891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:58.196251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:58.202757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 361/711] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:11:58 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:58.264261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3387a-d889-4852-b298-d280779e1f79 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:58.305355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:58.306610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:58.307087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:58.307555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.328049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:58.329982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:58.351937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:11:58.362331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 351/712] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:58.362796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:58.504580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7ab4e-3c88-48a8-9bc8-5d0d6c8a6f3f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:58.544738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:58.545829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:58.546310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:58.546819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.547736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:58.548714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:58.550450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6bd79-c78f-41d6-9ec5-98fcf3dabcbc None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:58.568846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 362/713] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:58.574396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:58.700447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7530-9538-4489-a72b-fb4207a80ff7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:58.747255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:58.748319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:58.749374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:58.750181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:58.751528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:58.753260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed53e-2313-456e-9e35-ea9b1f4d83c6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:58.843528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 352/714] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:11:58 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:11:59.012873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1e1b0-bc8e-42c7-bbbf-c072dad060b8 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:59.013387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1e1b0-bc8e-42c7-bbbf-c072dad060b8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:59.013488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1e1b0-bc8e-42c7-bbbf-c072dad060b8 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:59.016183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 363/715] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:11:59.022234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:59.022234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:59.022787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:59.046813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:11:59.048047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:11:59.141355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 353/716] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:11:59.164520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1e1b0-bc8e-42c7-bbbf-c072dad060b8 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:59.286236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1e1b0-bc8e-42c7-bbbf-c072dad060b8 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:59.323785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:59.324582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:59.324863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:59.325136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] PATH_INFO: `/v3/services/network` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:59.325816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:59.327246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:59.340552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 25 03:11:59.342074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 364/717] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:11:59 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:11:59.348129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:59.467057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075b6ba-5de0-4c11-8365-4d39ac23e4d3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:59.514266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:59.514963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:59.515240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:59.515512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:59.516209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] RBAC: Adding query filter params (name=network) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:59.516510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:59.518033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4460-000b-4a15-bbad-7ed67f385828 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:59.524975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 354/718] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:11:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:11:59.530630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:11:59.648136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34b22-7947-44f1-875c-56ec065e7a69 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:11:59.686776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:11:59.687430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:11:59.687710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:11:59.687982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:11:59.688678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] RBAC: Adding query filter params (type=network) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:11:59.688980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:11:59.690438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00897b62-1dad-47af-a27a-550fc9afacc7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:11:59.698811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 365/719] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:11:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:00.719468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41230cb-f674-46e8-b643-8d4d3fdf113d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.719983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41230cb-f674-46e8-b643-8d4d3fdf113d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.719983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41230cb-f674-46e8-b643-8d4d3fdf113d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.721776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 355/720] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:00.726776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54c3-61e5-4009-b51f-93510c446bea None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.727164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54c3-61e5-4009-b51f-93510c446bea None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.727340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54c3-61e5-4009-b51f-93510c446bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.746859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7d1f54c3-61e5-4009-b51f-93510c446bea None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:00.748058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7d1f54c3-61e5-4009-b51f-93510c446bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:00.767247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a36d-9d98-4221-b0a5-7c95c07e5835 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.767831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a36d-9d98-4221-b0a5-7c95c07e5835 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.768293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a36d-9d98-4221-b0a5-7c95c07e5835 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.771934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 356/721] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:00.776435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.777199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.777700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.802993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:00.804177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:00.857042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 366/722] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:12:00.865910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e82b4-c2e7-4467-9df1-db4618b944ae None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.866201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e82b4-c2e7-4467-9df1-db4618b944ae None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.866475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e82b4-c2e7-4467-9df1-db4618b944ae None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.868402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 367/723] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:00.873173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:00.873451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:00.873770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:00.898711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:00.899859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:00.913683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 357/724] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:12:00.913683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:00.998234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 368/725] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 25 03:12:00.998234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.043497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d996d3-1cf7-40f5-ac42-3f7677e5c76d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.078745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.078967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.079247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.079524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.080238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.081915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.111416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ab6-5b91-4728-9aed-c029f5c3a63b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.145786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.146572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.146857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.147125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.157938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:01.164766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:01.171020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 369/726] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:01.171020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.195177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 358/727] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:00 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:01.196385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.295449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95f07-82bf-4cde-a392-df9780c1aa76 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.358688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.359874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.360371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.360835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.373373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:01.382538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:01.384498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 370/728] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:01.392653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.466719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf49d3-fce2-4681-bbf7-16bf5db501de None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.514574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c168-ca0c-4de5-b41e-19ce24a82869 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.524053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.524726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.525418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.525418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.526119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:01.526423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.528043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.541174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 359/729] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:01.543944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.566653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.567907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.568386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.569020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.570495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:01.571071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.573087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.584177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 371/730] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:01.590515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.649607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ee3fc-4495-4deb-a7b8-79beda17a205 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.687976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.688849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.689206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.689590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.701292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.702954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.713509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef89f-f24e-4e92-81a0-e20e1ebfe665 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.720466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:01.722150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 360/731] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:01.727630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.751028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.751965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.752319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.752667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.763856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.765510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.782897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:01.784448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 372/732] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:01.790021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.836248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59029a5e-9cc8-4ddf-bee4-1c7d18db32e3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.869986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.870947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.871425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.871865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.872753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:01.873222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.875423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.888755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 361/733] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:01.894499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:01.911876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d211389-bcbc-42d3-8718-6e17cc84d63c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:01.968468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:01.969353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.975022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.975515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.976426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:01.976937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:01.978509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d446d41-cc26-4a72-91f3-cb0a396a605a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:01.991293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 373/734] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:01.993018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c0a2-b93d-4628-99c2-58ecdf409489 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:01.993481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c0a2-b93d-4628-99c2-58ecdf409489 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:01.993979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c0a2-b93d-4628-99c2-58ecdf409489 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:01.996507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 374/735] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:01.997403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1c0a2-b93d-4628-99c2-58ecdf409489 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.020627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4f25c-e977-4dc2-8b1e-0ca5f28376fe None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.055419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.056304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.056485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.056758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.064133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.065655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.080114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-638b50d4-6e8a-4f3c-bbb3-e1d61d86324b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:12:02.081942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 362/736] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:02.083197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.083479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.084061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.100777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:02.102001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:02.104406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1c0a2-b93d-4628-99c2-58ecdf409489 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.139197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.140794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.141250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.141708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.149060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.150757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.164892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:12:02.166655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 375/737] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:12:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:02.167998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.177937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 363/738] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:12:02.178879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.298040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aedea-89bf-44be-9e42-186af772e4e4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.300373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ef0a-d209-4d5b-a6f5-a59be9f30776 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.335584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.336676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.337153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.337620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.338691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:02.339204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.340739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.341215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.341422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.341737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.342021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.343720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:02.344235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.348721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.365194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 364/739] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:02.366466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.373289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 376/740] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:02.374213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.513525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabd3e7-651e-42ce-9e1c-96f6ec166100 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.519587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a565bc-17a5-4f2e-aa1b-a8b101c7772d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.556764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.557878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.558299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.558712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.568804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.570207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.570410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.570753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.571123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.572315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.584557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:02.593889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:12:02.595559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 365/741] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:02.597103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.606901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:02.608639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 377/742] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:02.609732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.724860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a43140-b7aa-4fc1-93ae-fc78963b7e86 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.761350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.762148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.762500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.762621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89816d-853a-4576-a15d-aeef1abbf531 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.763030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.798960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.799621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.799898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.800171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.800901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:02.801199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.802601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.815598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 378/743] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:02.815598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.839836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.841619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa49f3-3d9b-4085-bc1c-d7edc252c8ac None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:02.935089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b983107-78b9-4c4d-af9a-d40414e38020 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:02.948300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 366/744] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 25 03:12:02.954587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291fbe-6521-4c2c-9385-e9ac0e00b043 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.954880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291fbe-6521-4c2c-9385-e9ac0e00b043 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.955160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291fbe-6521-4c2c-9385-e9ac0e00b043 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.961313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 367/745] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:02.962186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291fbe-6521-4c2c-9385-e9ac0e00b043 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:02.986907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:02.987663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:02.988253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:02.988544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:02.989542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:02.989893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:02.992075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.007191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 379/746] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:03.008090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.088568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291fbe-6521-4c2c-9385-e9ac0e00b043 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.115592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5740a5-3562-42a3-be8b-480b1ef2ceea None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.128728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.130231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.130661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.130938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.141789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.143278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.149734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.150617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.150897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.151163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.160102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-360d8c24-11e9-4fbb-ac17-e685fcefeba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:03.161079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.165966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 368/747] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:03.166110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.166202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.166202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.166202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.180701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:03.181898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:03.183029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:03.184537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 380/748] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:03.185403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.251404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 369/749] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 25 03:12:03.252273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.297549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef63-a879-4bae-9bca-f267db260d12 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.332470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.333261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.333541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.333904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.340513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.341986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.351321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5da5e4-3600-44bb-ac49-451ba77fe3c6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.354593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:03.361030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 381/750] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:03.361030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.388713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.389901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.390201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.390745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.391474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:03.391777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.393951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.409175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 370/751] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:03.409175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.463093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba0bfe-30e9-4cf8-b48b-bd3f983adddb None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.495819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.496480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.496765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.497041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.497779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:03.498088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.499516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.506137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535cc6-1d35-4bb5-8423-8d20234e039a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.516645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 382/752] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:03.516645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.544056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.544732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.545009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.545281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.546592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.548028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.625696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 371/753] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:03 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:03.625953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16747c-1b99-4ab5-8d75-0c4866e14cce None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.626065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.678532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.679247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.679533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.679967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.681192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:03.681510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.683672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.705862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 383/754] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:03.708178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.746278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832716d0-b142-4667-81f3-37b6f8cadfd6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.782795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.783535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.783811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.784132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.792836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.794357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.810339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:03.813052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 372/755] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:03.813859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.820798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5917-894d-4b4c-ac4b-512d448f3998 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.857824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.859042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.859576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.859855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.866899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.868415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.885016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:03.886536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 384/756] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:03.887316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:03.929650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562980c-d99c-4b68-864c-7ff3aa661764 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:03.972876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:03.972876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:03.972876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:03.973390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:03.975859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=ba728b1294014f94b7acab7ccf594ce7, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:03.977309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63c6b-4250-43bd-80d2-9596fd279008 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:03.995286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1de30-83ca-4194-9cf0-ac99e0ea870b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.027498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.028249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.028541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.028813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.029626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:04.030524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.031955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.101651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 385/757] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:04.102507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.124799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 373/758] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:03 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:12:04.127226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7451b6-74bd-4d39-b53f-8a264d9d307c None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.129631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7451b6-74bd-4d39-b53f-8a264d9d307c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.129631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7451b6-74bd-4d39-b53f-8a264d9d307c None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.131100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 374/759] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:04.132332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7451b6-74bd-4d39-b53f-8a264d9d307c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.211756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7530-8df2-4441-b382-7ba28387d6b5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.249517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.250454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.250837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.251268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.252185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:04.252630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.254228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3637c-dc1f-407e-9e29-e5bd3a1f8cd2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.273457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 386/760] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:04.274077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7451b6-74bd-4d39-b53f-8a264d9d307c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.275228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.275617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.275990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.293882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:04.295254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:04.324319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.325111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.325619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.325764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.379152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 387/761] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:04.380205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.406906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.408690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.488672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ee48-0753-48a3-bd97-3a0091778d62 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.522825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.523480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.523758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.524031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.524844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f5956fc6e9b848298d2623b191e841c9) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:04.525151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.526629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.532918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 388/762] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/role_assignments?user.id=f5956fc6e9b848298d2623b191e841c9&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:04.533998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.544436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 375/763] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:04.552641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.741256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360af79-13ff-47ff-ab8d-a49af219244b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.743862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803025b9-fb66-4435-b23e-b5ab3a789ef7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.776070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.776852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.777126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.777393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.787041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.788037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.788305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.788797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.789276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.789485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.790337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.791904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.803932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 25 03:12:04.809686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:04.809686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 376/765] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:04.810075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 389/765] 10.222.0.24 () {56 vars in 1129 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:04.812715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.815301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:04.914480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588d679-e6f7-4ccd-a795-d7adc97ebc21 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.938605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe7e6-fd56-4dea-9203-2f446ec44211 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:04.970765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.971425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.971699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.971968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.972661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:04.972960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.974372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.978678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:04.979604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:04.980085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:04.980558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:04.981468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:04.982006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:04.984144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:04.986253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 377/766] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:04.992787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.002941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 390/767] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:05.008533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.162299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf75ac0-cac4-4c5e-bcfd-17d1c4ca40fa None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.190320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6475c-6d36-408a-acad-d7f43f004f9c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.235275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.236324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.236661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.236996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.247415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.248012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.248286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.248583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.249300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:05.249618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.251040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.254930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.256764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.259614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 378/768] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:12:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:05.266116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.281350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:05.284771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 391/769] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:05.293441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.437712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff9431-5216-498d-a2f7-a5e183439cbb None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.477384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a87e-051c-4550-8ce9-687b9ee877c4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.483765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.484905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.485234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.485547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.486402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] RBAC: Adding query filter params (interface=public, service_id=26361bbe388a47ed8488af8a99d76b23, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:05.486711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.488336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.501380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 379/770] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:05 2022] GET /identity/v3/endpoints?service_id=26361bbe388a47ed8488af8a99d76b23&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:05.506699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.545627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.546333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.546595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.546868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.547646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:05.547952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.549384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.564954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 392/771] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:05.570728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:05.687085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affbeb2-90cc-4622-ab6d-5df4d99b548f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.726891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.727549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.727831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.728110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.728926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=c1ad3502a895428e96aa792a5c54cba1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:05.729234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.730686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769cd5-def4-4159-ab86-05471b874876 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.738750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc762-08b4-4fcc-bf39-fdb705bdab3f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:05.744398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 393/772] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:05 2022] GET /identity/v3/role_assignments?user.id=c1ad3502a895428e96aa792a5c54cba1&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:05.781141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:05.781906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:05.782256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:05.782596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:05.783343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:05.784804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e7cd0-9e8a-447e-ba6b-d3ae7dbdbae5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:05.790870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 380/773] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:05 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:06.282180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eccad4-45fe-4c45-8cc3-c163667c3de2 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.282706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eccad4-45fe-4c45-8cc3-c163667c3de2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.282706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eccad4-45fe-4c45-8cc3-c163667c3de2 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.284766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 394/774] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:06.289837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.290373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.290883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.314748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:06.315936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:06.399969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 381/775] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:06.435166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eccad4-45fe-4c45-8cc3-c163667c3de2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:06.582977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eccad4-45fe-4c45-8cc3-c163667c3de2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:06.626740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:06.627544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.627825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.628095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] PATH_INFO: `/v3/services/network` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.628750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:06.630155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:06.641212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-90baaccf-2c1f-47a0-841c-8281f2f31439 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 25 03:12:06.646800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 395/776] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:06 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:06.652615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:06.761723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b434a9-0c7b-4c9c-b566-24446520758a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.762074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b434a9-0c7b-4c9c-b566-24446520758a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.762278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b434a9-0c7b-4c9c-b566-24446520758a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.764197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 396/777] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:06.773734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.774014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.774296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.794556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01cc11-8af9-42a9-b2d4-94e2ce93aecd None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:06.801905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:06.803267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:06.859828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:06.860865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:06.861373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:06.861873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:06.862835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] RBAC: Adding query filter params (name=network) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:06.863357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:06.864972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:06.876789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 382/778] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:06.883362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:06.884400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 397/779] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:06.907408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.007392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31fab-d3fa-4e21-b613-e9fcbd5b7570 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.044329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.044997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.045330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.045605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.046350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] RBAC: Adding query filter params (type=network) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:07.047003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.048393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.054258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 383/780] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:07.063183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.147027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27614a2-af6c-4004-bc0f-e4fdfe3e5bef None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.219635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.220428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.220712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.220984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.241562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26f6c-a2cd-4deb-86cf-33564be38b0d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.246600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:07.253954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:07.262133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 398/781] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:07.269542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.283641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.284300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.284583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.284858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.285681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] RBAC: Adding query filter params (interface=public, service_id=52c1a3c0270f42709ebe3bd74a6dc9c7, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:07.285994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.289171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.298306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 384/782] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/endpoints?service_id=52c1a3c0270f42709ebe3bd74a6dc9c7&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:07.303656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.395129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654adcf5-f82e-405a-9e3d-8cf28d6895a8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.410580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784a2fc-b0f2-4853-b406-b34c0d686ec0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.430599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.431530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.431974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.432392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.433265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:07.433740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.435262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817fa5f-cb10-4046-a709-80eb4eea7db0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.446811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.447702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.448152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.448574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.448808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 399/783] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:07.449628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.450152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfc4-2764-4ff9-bb4d-1b4604f98aee None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.450441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfc4-2764-4ff9-bb4d-1b4604f98aee None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.450717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfc4-2764-4ff9-bb4d-1b4604f98aee None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.451887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7a9f9-3aa3-4884-a27b-16ad3450050d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.452622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 400/784] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:07.453310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6bfc4-2764-4ff9-bb4d-1b4604f98aee None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.458440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 385/785] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:07.459922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.460386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.460826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.478865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:07.480397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:07.560414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6bfc4-2764-4ff9-bb4d-1b4604f98aee None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.562581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 386/786] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:07.599924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.600122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.600854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.601132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.601400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.613350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.614582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.631299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:07.632747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 401/787] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:07.641710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.772648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655de73-a731-4e91-a56d-79a8f036dc3d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.774344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c158bd-7cfa-4887-bf3c-6c338b61ee3c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.811602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.812461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.812744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.813016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.815385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:07.816475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:07.816905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:07.817361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:07.818652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:07.819128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:07.821091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:07.823525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:07.833250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:07.835075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 387/788] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:07.836007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 402/789] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:07.840549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.844518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:07.985412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4860-4c83-439f-a03e-1e78c762f0ed None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:07.994267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66bc3e-2bfc-47a2-adff-6c1eda9ed0ff None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.045686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.046284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.046564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.046865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.047720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:08.048031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.049430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.062419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.063207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.063490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.063764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.064351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 388/790] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:08.071341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.072982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.074456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.098816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:12:08.101821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 403/791] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:12:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:08.111236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.189731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51a1a-11fd-49ce-b9c3-dbcab2844362 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.229057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.229899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.230188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.230627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.243979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.245635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.271799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:08.273026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 389/792] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:08.282022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82c14-7219-4409-af25-b69a59b3b221 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.284303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.355131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.355859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.356141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.356416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.357260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:08.357567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.359101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.396031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 404/793] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:08.400189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.479512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c5a4e-ba89-484e-bf6d-7a8c0c5d6b66 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.544287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.544949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.545260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.545535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.546289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:08.546592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.547972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa642-f5f1-47ff-8de6-bbc90be9899e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.549693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee038-f1f9-4951-a526-d74cc7457c62 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.560474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 390/794] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:08.562415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9cde0-ed76-4e9f-9b5b-b08011e36636 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.562696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9cde0-ed76-4e9f-9b5b-b08011e36636 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.562963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9cde0-ed76-4e9f-9b5b-b08011e36636 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.569039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 391/795] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:08.570323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.570603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.570876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.585997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.586650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.586934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.587282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.590067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:08.591254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:08.662064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.663568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.666005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 392/796] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:08.666910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.782281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 405/797] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:08.782281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.782527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5f2f-473b-4d9e-968e-a1d12a074b7c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.811690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.812970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.813249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.813515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.820636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.822174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:08.836687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ed54d881-290b-472d-aca1-c5e72c1ab309 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 393/798] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660b85-69e6-487f-be83-beae07a1ad6d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660b85-69e6-487f-be83-beae07a1ad6d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660b85-69e6-487f-be83-beae07a1ad6d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 394/799] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:08.843633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed660b85-69e6-487f-be83-beae07a1ad6d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.877245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b835d6a-f6c0-43b3-9391-efb11dcb8ddf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.910496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.911287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.911572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.911844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.922375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:08.929192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:12:08.935019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 406/800] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:08.935019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:08.942805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed660b85-69e6-487f-be83-beae07a1ad6d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:08.979406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:08.980236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:08.980578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:08.980961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:08.991885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:08.993514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.010462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-bb104049-f4e3-4b52-8374-78e446a73e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:09.016373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 395/801] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:09.016373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.016373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.016373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.030651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:09.035217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:09.036605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98acd-32fc-4774-8332-0c3890a1f412 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.071608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.072270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.072548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.072820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.073626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.073967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.075564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.097598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 407/802] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:12:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.098326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.109683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 396/803] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:09.109683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.193982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fea3a-2e2f-4a4f-a14d-2b924e16b681 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.208614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7cce0-5382-43a1-8fbc-6c33a8f6bca6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.226991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.227639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.227915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.228183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.228907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.229204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.230589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.239035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 408/804] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.239954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.248553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.249242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.249525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.249840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.250558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.250861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.252239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.268110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 397/805] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.268110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.351160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a711f1-7f85-4682-9791-5109fa58377c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.370039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb32d2-fe96-42ca-ba82-1c273bc5caa4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.385698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.385698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.385698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.385698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.398971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.400707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.403351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.404152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.404436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.405254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.405948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.407353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.417813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:09.418607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 25 03:12:09.419413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 409/806] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:09.420368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.424347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 398/807] 10.222.0.24 () {56 vars in 1129 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:09.425184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.523569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c01c89-6e63-4faa-b239-d5585d6522cb None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.523845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf30994-faee-4a95-82f4-d9a1cc07cc16 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.556447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.556644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.557234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.557339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.557507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.557610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.557805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.557961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.564589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.566070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.568382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.569914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.581112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:09.587032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 399/808] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:09.587032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.587253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:09.587997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 410/809] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:09.593208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.684549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea13c5-c4d9-4f19-97f4-8e85da5d4264 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.692512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6beeb-a4a4-4e60-a6ca-23dfaf8e20e5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.721762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.722430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.722711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.722984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.723721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.724023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.725464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.726110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.726766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.727046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.727321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.728012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.728313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.729703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.738275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 411/810] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.738275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.740908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 400/811] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.745171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.835027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd1e2-36b9-4279-b461-0b862564f34d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.845108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad85d-6484-4972-865d-0ef98aaffb13 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.867314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.867967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.868250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.868524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.869293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.869596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.871054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.877250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:09.877930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:09.878208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:09.878476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:09.879180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:09.879476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:09.880827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:09.888039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 412/812] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.888039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.893184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 401/813] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:09.897644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:09.990004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b22-9dbb-40d7-bc30-a6dca4e38401 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:09.996593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6400e-3a9c-4b79-969b-6dca2e4572f9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.025059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.025752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.026041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.026314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.027010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:10.027316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.028688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.031820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.032661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.032939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.033258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.033725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 413/814] 10.222.0.24 () {56 vars in 1124 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:10.038798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.040315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.041813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.054858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:10.061444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 402/815] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:10.061444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.135134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640b4cc-6f1d-4e3b-a20e-f93045ae5610 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.157060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b5b87-2d8e-4486-b5e4-6b34d86d86b8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.167467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.168111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.168391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.168666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.169468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:10.169804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.171766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.177258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 414/816] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:10.178027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.190890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.191731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.192016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.192294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.201461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.203020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.218299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:10.219880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 403/817] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:10.220716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.282675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1a87-e598-4126-97fd-fe11bed185ed None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.318190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.318855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.319134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.319404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.320172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.321554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.324999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa77cd-f35f-4a3c-b25e-124c6cabfa31 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.361265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.362005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.362282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.362550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.363315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:10.363683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.365697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f07e-cf96-4f1c-8a75-0f8ac119fb0f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.377680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 404/818] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:10.379315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550278e-f4e8-4247-9438-100604c48f29 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.379577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550278e-f4e8-4247-9438-100604c48f29 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.379846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550278e-f4e8-4247-9438-100604c48f29 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.381454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 405/819] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:10.382163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550278e-f4e8-4247-9438-100604c48f29 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.427067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 415/820] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:10.428667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.501180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550278e-f4e8-4247-9438-100604c48f29 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.538732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.539256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e849dac-1505-4c8e-9db5-2a7ae02c250f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.539437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.539689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.539962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.540862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:10.541167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.542720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c66d15-6c69-4c6b-9395-a7feaba605b3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.563099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 406/821] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:10.564241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.564527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.564796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.579218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.580771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.581271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.581798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f5956fc6e9b848298d2623b191e841c9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.583541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:10.584385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=f5956fc6e9b848298d2623b191e841c9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.584865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:10.586355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.656330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 407/822] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:10.657117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.702303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 416/823] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:10 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/f5956fc6e9b848298d2623b191e841c9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:12:10.703350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.830143 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a0d0-86a8-4299-ad97-8f911c4c4901 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.860612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26071-db00-47e9-815b-4777c7cda933 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:10.895010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.895817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.896095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.896364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.901599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:10.902463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:10.902743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:10.903013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] PATH_INFO: `/v3/services/network` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:10.903657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.905063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.916065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:10.916996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 25 03:12:10.918145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:10.918567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 417/824] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:10.924808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:10.938998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:10.945149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 408/825] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:10.946597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.029618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c922-3943-43c9-904c-0ccc76543bfe None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.048860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dc257-8920-45ef-ba51-bdd60240eb63 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.064464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.065126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.065467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.065772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.066488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] RBAC: Adding query filter params (name=network) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:11.066776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.068274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.073388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 418/826] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:11.078841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.085277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.086000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.086292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.086560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.087295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:11.087611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.089001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.105102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 409/827] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:11.106410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.179047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32307a4-0751-4bc5-b50e-d6d332987f9c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.210599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afbcba-4c9c-484a-b996-a55bb2876088 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.220280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.220885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.221486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.221793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.222788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] RBAC: Adding query filter params (type=network) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:11.223094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.225056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.231672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 419/828] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:11.239248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.265129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.265955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.266229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.266496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.286497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.287975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.309271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:11.317152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 410/829] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:11.331424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.351811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c31ab-c1c8-4576-9787-b7c37f199304 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.393700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.393700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.393700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.393700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.394378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.395765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.466358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b970e1-2d2d-4843-a2bd-2778e0584aa9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.477901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 420/830] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:11.518565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.519239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.519521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.519795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.520575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:11.520880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.522411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5a4e-6dd8-4cd8-b7eb-ad868a4a555c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.540672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 411/831] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:11.542168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:11.682804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2025c0-deda-481b-af29-c7c19cc6c7d6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:11.729981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:11.730798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:11.731079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:11.731368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/c1ad3502a895428e96aa792a5c54cba1/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:11.751847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=c1ad3502a895428e96aa792a5c54cba1, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:11.753598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868851f-15d6-46b4-8871-86145359d733 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:11.843903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 421/832] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:11 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/c1ad3502a895428e96aa792a5c54cba1/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:12:12.665738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc321-7274-4696-b5b8-f9030af7662a None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:12.666248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc321-7274-4696-b5b8-f9030af7662a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:12.666322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc321-7274-4696-b5b8-f9030af7662a None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:12.668289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 412/833] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:12.673613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:12.674051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:12.674240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:12.691430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:12.692629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:12.760624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 422/834] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:12.782736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dc321-7274-4696-b5b8-f9030af7662a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:12.883601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dc321-7274-4696-b5b8-f9030af7662a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:12.918018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:12.918762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:12.919056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:12.919336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:12.920028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:12.921426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:12.933244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-57628ebf-9688-4694-a142-27b67b6acaec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 25 03:12:12.934840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 413/835] 10.222.0.24 () {56 vars in 1132 bytes} [Fri Mar 25 03:12:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:12.940874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:12.969388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38fac-65bc-45e3-b1b9-7fb29912c218 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:12.969688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38fac-65bc-45e3-b1b9-7fb29912c218 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:12.969967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38fac-65bc-45e3-b1b9-7fb29912c218 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:12.971888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 414/836] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:12.978401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced0604-d725-4584-a196-08171190daf5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:12.978401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced0604-d725-4584-a196-08171190daf5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:12.978401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced0604-d725-4584-a196-08171190daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:12.996411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-1ced0604-d725-4584-a196-08171190daf5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:12.997604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1ced0604-d725-4584-a196-08171190daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:13.059232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e85b-fd52-4400-a0d3-6703b152eb71 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.069195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 415/837] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:13.091490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced0604-d725-4584-a196-08171190daf5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.101285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.102406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.102893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.103365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.104386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:13.104903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.106605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.112875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 423/838] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:13.118960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.213413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced0604-d725-4584-a196-08171190daf5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.235333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfc746-5e17-4389-a04b-a54f16df8308 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.251518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.253051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.253513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.254074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.254893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.256449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.267695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 25 03:12:13.269354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 416/839] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:13.274019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.274167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.274434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.274712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.275408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:13.275713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.277115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.278550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.282065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 424/840] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:13.392417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7b2e0-e8d9-4cec-8d51-43f25c142b1a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.428962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.429921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.430341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.430751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.431603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:13.432078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.433632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a48b-416e-42c1-bf6e-22dfe86177c5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.439880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 417/841] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:13.446806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.477973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19e8e-2716-4398-a437-f1d4989a32f4 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.478163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19e8e-2716-4398-a437-f1d4989a32f4 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.478443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19e8e-2716-4398-a437-f1d4989a32f4 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.480513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 418/842] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:13.486168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.486451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.486722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.506657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:13.507834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:13.562788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0367a-ed2e-473a-8c26-f4c38b917c21 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.588099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 419/843] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:13.604999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.605968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.606457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.606900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.608370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:13.608871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.610456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.612240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.620341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 425/844] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:13.727223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68613a26-4cab-4d9b-9c28-d502eee4f360 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.764558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.765820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.766120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.766369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.778319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:13.785432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:13.787052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 420/845] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:13.795166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:13.901072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b6e29-6b7c-45d3-b458-8cfb890ca97d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:13.935456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:13.936138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:13.936416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:13.936686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:13.937413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:13.937744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:13.939101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:13.947958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 426/846] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:13.953939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.057307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aedd60-3b5d-461c-9438-d6c3a9852fd0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.091674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.092996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.093276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.093543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.104233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.105777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.122825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f90b34cd-83c5-4f32-be93-71971697acd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:14.124933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 421/847] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:14.130442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.229692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5447-d571-44fa-ac0f-50d585024a8e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.241449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75633e07-a6dc-4a37-90c9-f0c00f34bd54 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.241770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75633e07-a6dc-4a37-90c9-f0c00f34bd54 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.242029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75633e07-a6dc-4a37-90c9-f0c00f34bd54 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.244656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 422/848] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:14.255625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.256018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.256392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.270176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.271042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.271472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.271892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.272779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:14.273227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.274785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.276265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:14.278296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:14.288238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 427/849] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:14.293375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.370196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 423/850] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:14.389244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.395014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2519-d9ee-4ea9-a52e-4ee360a2ec01 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.430735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.431754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.431863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.432075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.439884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.441357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.456613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 25 03:12:14.462256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 428/851] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:14.463292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.505405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db719c2-3f19-4b3c-aac1-83038d8c6686 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.552150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.553299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.553823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.554292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.567203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:14.577171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:12:14.583935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a5eb-bc15-4d15-80d5-34158716fa6f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.584583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 424/852] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:14.586489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.620066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.620862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.621037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.621342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.622315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:14.622555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.624033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.647810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 429/853] 10.222.0.24 () {56 vars in 1135 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:14.649125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.708616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4e52-4831-4228-a75c-92843485f9ea None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.742293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.742948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.743222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.743663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.744543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:14.745021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.746697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.755692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 425/854] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:14.761574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.764501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a25be8-5e56-4e19-a242-a1da2b725ab5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.807851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.808538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.808775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.809044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.865769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3b4e-ce2d-4bcb-8b29-c39909f53a51 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:14.886619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.888017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.900461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:14.901605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:14.902139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:14.902670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:14.914238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:14.916226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:14.932941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:14.939574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 426/855] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:14.940982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:14.993373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 430/856] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:14.999395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.075308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3055-d789-41ec-8a92-7d08ce274799 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.102862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7b58-2951-4510-a17f-90868e0d2804 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.117285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.118404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.118753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.119093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.120140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:15.120507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.122407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.141618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 427/857] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:15.143234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.144466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.145374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.145798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.146166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.159142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.161381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.180495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:15.186724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 431/858] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:15.188141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.259403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ecc06-4ac4-4910-9375-09b470247717 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.296018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.296883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.297162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.297430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.305447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.306977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.318446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5a81-2335-495d-b9a9-65dc2a001935 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.322507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:15.328712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 428/859] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:15.330227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.366902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.367949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.368443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.368918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.369868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:15.370861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.372830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.393142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 432/860] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:15.395467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.435741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a52be-a6a3-453d-9a3f-9cc0a07150a9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.471260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.471918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.472194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.472462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.473400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:15.473757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.475238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.497164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 429/861] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:15.499781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.521746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76188-8508-4fba-a994-a62f451f1e41 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.560562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.561721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.562633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.563115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.573472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.576768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.597586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:15.604392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 433/862] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:15.606667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.616458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90392-d84e-4f74-b14b-0ea088795b51 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.652247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.652818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.653092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.653361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.715874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e267949-365c-4fe1-8e97-c6e536f896af None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.719528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.720995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c02e0-6846-4315-947a-0f237a17575b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.756864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.758233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.758726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.759221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.760597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:15.761411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.763374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737059b-bf54-4c57-8b71-0c2f5993975d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.777306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 434/863] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:15.778750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197a0f-4ce8-4281-a3f6-899761bd3b62 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.779044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197a0f-4ce8-4281-a3f6-899761bd3b62 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.779352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197a0f-4ce8-4281-a3f6-899761bd3b62 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.781235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 435/864] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:15.783252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197a0f-4ce8-4281-a3f6-899761bd3b62 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.824374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 430/865] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:15.826966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.827483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.827952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.845718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:15.846910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:15.888464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197a0f-4ce8-4281-a3f6-899761bd3b62 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:15.913801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 431/866] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:15.913801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:15.934577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:15.936087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:15.936531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:15.936791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:15.937694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=f5956fc6e9b848298d2623b191e841c9) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:15.937994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:15.939590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:15.949489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 436/867] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/role_assignments?user.id=f5956fc6e9b848298d2623b191e841c9&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:15.950426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.024145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe539b6-9133-421a-9338-0d24108adf48 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.059633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1de4-f15f-446b-bea8-0ab9eb280505 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.061125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.061973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.062255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.062526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.075127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.077187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.095136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ad10a1ec-39e4-4fa4-bb43-62315fe09e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:16.096386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 432/868] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:16.097735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de721f-d0d6-4134-b632-f4fb94ca44b8 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.098024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de721f-d0d6-4134-b632-f4fb94ca44b8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.098298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de721f-d0d6-4134-b632-f4fb94ca44b8 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.100294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 433/869] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:16.102914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de721f-d0d6-4134-b632-f4fb94ca44b8 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.109609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.110318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.110601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.110876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.111620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.113025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276eb0c-afdc-41c5-bd24-aaaa917b25f2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.192528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 437/870] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:15 2022] POST /identity/v3/services => generated 269 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:16.193611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.193949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.194210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.215619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:16.217919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:16.227375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de721f-d0d6-4134-b632-f4fb94ca44b8 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.267427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.268553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.269060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.269596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.270679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:16.271184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.272844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.290970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 434/871] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:16.292318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.309690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 438/872] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:16 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:16.328365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.410068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95daa-eb0d-46f3-809c-c9c17b8d90e1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.450363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.451254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.451626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.452001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.459258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.460795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.461593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da9e5-3479-4827-ab67-06a7fd94be55 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.474909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:16.476526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 435/873] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:16.483807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.504780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.505457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.505762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.506037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.506769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.508563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.587721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cb93-f8ac-432f-90f3-d5c012dfba39 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.625710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 439/874] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:16 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:16.635737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.636412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.636689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.636955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.637829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:16.638133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.639762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6ab1-db59-40b7-a7c0-552489479bd8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.654059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 436/875] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:16.660870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:16.776003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8652b2-c752-4587-9a21-1522892a8557 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:16.813647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:16.814370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:16.814653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:16.814922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:16.815726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=c1ad3502a895428e96aa792a5c54cba1) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:16.816029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:16.817472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ded44-b270-4b1c-a85d-5508a1cf282e None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:16.824477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 440/876] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:16 2022] GET /identity/v3/role_assignments?user.id=c1ad3502a895428e96aa792a5c54cba1&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:18.340624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe308ef-1a3d-4146-9329-12bf0ebaa909 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.341121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe308ef-1a3d-4146-9329-12bf0ebaa909 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.341211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe308ef-1a3d-4146-9329-12bf0ebaa909 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.343785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 437/877] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:18.349242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e60f-37de-4f7c-bd54-a94c886f9935 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.349654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e60f-37de-4f7c-bd54-a94c886f9935 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.350001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e60f-37de-4f7c-bd54-a94c886f9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.366827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8529e60f-37de-4f7c-bd54-a94c886f9935 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:18.368015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8529e60f-37de-4f7c-bd54-a94c886f9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:18.441776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 441/878] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:18.457344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe308ef-1a3d-4146-9329-12bf0ebaa909 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:18.554051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f29ae9-b8f0-43bc-9252-c5ba4641a712 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.554368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f29ae9-b8f0-43bc-9252-c5ba4641a712 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.554610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f29ae9-b8f0-43bc-9252-c5ba4641a712 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.556673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 442/879] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:18.562682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe308ef-1a3d-4146-9329-12bf0ebaa909 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:18.562970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.563259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.563538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.580905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:18.582127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:18.603723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:18.604446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.604724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.604993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.605629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:18.607047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:18.621266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 25 03:12:18.622817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 438/880] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:18.629267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:18.669963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 443/881] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:18.693149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:18.761689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0973-0aef-45c8-b396-31d7157e983e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:18.796384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:18.796943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.797228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.797498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.798237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:18.798539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:18.799917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:18.805053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 439/882] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:18.811560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:18.812032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343037-4a15-44c7-ab5a-3e82e58c510d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:18.858580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:18.859876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.860794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.861252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.862422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:18.864649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:18.881084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 25 03:12:18.889037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 444/883] 10.222.0.24 () {56 vars in 1132 bytes} [Fri Mar 25 03:12:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:18.890580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:18.920766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88674137-a64c-45be-bb63-d1b294541e77 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:18.958427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:18.958427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:18.958427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:18.958427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:18.958989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:18.959222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:18.960602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c712fb6-675a-4338-8a65-ee3152dac42a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:18.974137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 440/884] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:19.009622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e86b2-6a63-4948-983a-2cc6c0f78b96 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.009993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e86b2-6a63-4948-983a-2cc6c0f78b96 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.010269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e86b2-6a63-4948-983a-2cc6c0f78b96 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.012174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 441/885] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:19.018907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.019555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.020025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.026051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22fba-aa0c-4b0f-81f0-8e620aea7309 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.043644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:19.045716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:19.064241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.064995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.065285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.065563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.066540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.066870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.069201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.080072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 445/886] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.082250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.145220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 442/887] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:19.167116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.207927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451766-a69f-473e-a7ef-72ff192885ca None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.243029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.243687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.243971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.244248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.244951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.245274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.246664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8c90-ee6f-4a6d-806c-c9d9e311018f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.251890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 446/888] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.253095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60327f-80e6-49b3-a99c-9fe44a518112 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.253381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60327f-80e6-49b3-a99c-9fe44a518112 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.253655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60327f-80e6-49b3-a99c-9fe44a518112 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.255458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 447/889] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:19.259831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60327f-80e6-49b3-a99c-9fe44a518112 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.286625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be739-fbe6-4645-8b7b-fca450661fcc None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.321611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.322794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.323260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.323685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.324460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.326054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.337263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-15afee0a-943d-4864-a126-20a9787a36d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 25 03:12:19.338813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 443/890] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:19.340266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.340553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.340828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.358963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:19.360330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:19.360910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60327f-80e6-49b3-a99c-9fe44a518112 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.393409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.394097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.394379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.394655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.395484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] RBAC: Adding query filter params (interface=public, service_id=1091f07494ba4c7a8726746922fadc07, region_id=RegionOne) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.395733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.397098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.404258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 448/891] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/endpoints?service_id=1091f07494ba4c7a8726746922fadc07&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.405032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.430398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 444/892] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:19.433850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.510013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefbc4-26b7-4dac-954b-d47e6a6d5b14 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.532541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f44a6-ca9f-4b1d-9261-f94510bae662 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.543688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.544570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.545548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.546025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.549942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.549942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.549942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.553239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 449/893] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.554167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.567483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.568147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.568434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.568711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.569386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.570803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.576435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 445/894] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:12:19.577198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.689742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4065e4-da60-4952-94d8-fd7a596a04f6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.690116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55ea09-df66-4793-b90f-d8a2789fc0f0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.726639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.727559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.727908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.728318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.729109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.730040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.730509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.730957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.731873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.732952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.734579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 446/895] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.746022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:19.746779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.756083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:19.758476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 450/896] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:19.765709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.868062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51cc1-726d-4fbd-b6bf-c52540b7ea1d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.883946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21365f3-d760-43ea-acc3-f1feb6b0de3e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:19.903909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.905239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.905625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.906025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.906944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] RBAC: Adding query filter params (interface=public, service_id=b3a7811bc1024be7a205b61ba8a68915, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.907349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.908841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.914527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 447/897] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/endpoints?service_id=b3a7811bc1024be7a205b61ba8a68915&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:19.919916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:19.930635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:19.931164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:19.931446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:19.931721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:19.932463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:19.932769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:19.934213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:19.943228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 451/898] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:19.948152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:20.033040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971e10-ea3b-4994-9851-9128a6eeb6bf None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.064568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517f13-f425-4c73-996c-1360b23f9c00 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.076695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.077882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.078737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.079328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.080295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.082718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.098151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 448/899] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:12:20.107825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.108640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.108920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.109193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.121309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.122875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.141267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:20.142936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 452/900] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:20.148837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:20.253547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d63b-59e0-4687-8d49-7e22ecc329b5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.288970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.289643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.289951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.290226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.290948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:20.291249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.292643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.305283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 449/901] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:20.311311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:20.415633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944aaa4-37a7-4fc0-8d1e-952becbeef2c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.450560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.452301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.452787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.453252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.461336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.463020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.476702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:20.478490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 453/902] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:20.484462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:20.587670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e90b95-6207-4af2-9c87-77eea8120c5d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.621657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.622358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.622638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.623532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.624405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:20.624711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.626189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.643724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 450/903] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:20.649210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:20.752242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074a5f-05ac-4f35-932e-91d8c5f41a0a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:20.787163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:20.788153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:20.788658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:20.789128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:20.856563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:20.858497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:20.957905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 454/904] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:20.966832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.075162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe870-a035-4137-a470-d2f686ade06d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.114940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.115655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.115919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.116190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.126683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.128693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.145410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:21.146909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 451/905] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:21.152372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.251210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976006-f8c9-4e36-bb72-93dae0388794 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.285408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.286086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.286362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.286629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.287328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:21.287624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.288999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c7eae-3e8a-447c-ad97-eb98f5246500 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.301292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 455/906] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:21.310825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.366322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f171a-4885-4a3c-9e2b-f0fe91fbd0b3 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.366615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f171a-4885-4a3c-9e2b-f0fe91fbd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.366846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f171a-4885-4a3c-9e2b-f0fe91fbd0b3 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.369767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 456/907] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:21.374530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.374818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.375097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.391757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:21.392940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:21.417893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cc99-ef7b-4fb4-ac17-fc6b035ad4a6 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.463822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.464613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.464887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.465152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.472598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.473522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 457/908] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:21.474129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.486928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:21.488368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 452/909] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:21.489845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.494145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.595032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820800-78a7-43f5-9543-bb3c52add27c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.596775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519713-e54e-4a6e-a369-3a85fe225064 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.631244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.631458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.632133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.632417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.632691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.633010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.633478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.633578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.634062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.635046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:21.635267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e37923-14b1-422e-8de1-da71c43ee2d8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.635749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.637366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.650764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 453/910] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:21.657268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:21.728541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 458/911] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:21 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:21.771251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ab79-5aca-4f51-88d2-1ed1788c5d3f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:21.817868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:21.818993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.819476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.820021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.821097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] RBAC: Adding query filter params (role.id=3a8e89905f894a3caeea6627c55420cc, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=c1ad3502a895428e96aa792a5c54cba1) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:21.821613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:21.823441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23c284-2d7c-4228-a509-fdedfdd24616 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:21.830790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 454/912] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:21 2022] GET /identity/v3/role_assignments?user.id=c1ad3502a895428e96aa792a5c54cba1&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=3a8e89905f894a3caeea6627c55420cc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:21.950994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a809-4461-4748-b022-47bf4fd855b2 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.951677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a809-4461-4748-b022-47bf4fd855b2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.952275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a809-4461-4748-b022-47bf4fd855b2 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.954661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 459/913] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:21.960322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:21.960607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:21.960885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:21.982741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:21.984288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:22.055649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 455/914] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:22.078066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6a809-4461-4748-b022-47bf4fd855b2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:22.178697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6a809-4461-4748-b022-47bf4fd855b2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:22.213226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:22.213973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.214251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.214517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.215150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:22.217057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:22.228196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 25 03:12:22.229641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 460/915] 10.222.0.24 () {56 vars in 1132 bytes} [Fri Mar 25 03:12:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:22.236258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:22.339283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83318d-0b15-4b65-83bf-28a7446121b6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:22.373482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:22.374193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.374474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.374748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.375438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:22.375739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:22.377170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:22.382162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 456/916] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:22.387527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:22.486157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f01e-3391-4a92-a9e7-982d280cc1d8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:22.522510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:22.523166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.523447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.523719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.524411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:22.524713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:22.526106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe067b-3141-4d5d-8ef1-43ed439d18eb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:22.531877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 461/917] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:22.538706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:22.605268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe3c9-ab7e-4a67-b87f-7cb993833c98 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.605553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe3c9-ab7e-4a67-b87f-7cb993833c98 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.605880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe3c9-ab7e-4a67-b87f-7cb993833c98 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.608506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 462/918] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:22.613305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.613588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.613904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.630445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:22.631628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:22.644299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4873-8574-40fc-9f8b-dfb8d892bd67 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:22.682279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:22.682987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.683268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.683540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.684330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:22.685770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:22.702422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 463/919] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:22.725357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:22.786994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 457/920] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:22.838921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e6c1a-5730-4f5f-9c50-15b56e9a88ea None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:22.884407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:22.885218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:22.885496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:22.885801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:22.886460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:22.887871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:22.900735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 25 03:12:22.902358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 464/921] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:22.908804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:23.021498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc9852-2d15-4c77-84ca-2c09b1410c29 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:23.055709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:23.056699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:23.057194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:23.057695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:23.058656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:23.059147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:23.061301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:23.066661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 458/922] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:23.072478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:23.172416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b40e5-30e1-4fcb-ad7c-6414c52e9888 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:23.206109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:23.207183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:23.207659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:23.208206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:23.209088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:23.209580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:23.211159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1eb-c646-480d-a578-6ed5ad1741f6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:23.216917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 465/923] 10.222.0.24 () {56 vars in 1114 bytes} [Fri Mar 25 03:12:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:23.222684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:23.324062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb462df1-dbdb-411d-8480-948b05d45670 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:23.356543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:23.358134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:23.358769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:23.359244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:23.360226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:23.361866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a30aa6-aa1a-4d44-84dc-d1e87476d2f3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:23.485090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 459/924] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:24.133649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909292e-521b-44f1-a0d1-e3eacb0fe9bd None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.134673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909292e-521b-44f1-a0d1-e3eacb0fe9bd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.135171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909292e-521b-44f1-a0d1-e3eacb0fe9bd None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.137380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 466/925] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:24.143320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc728c2-e4f7-4e90-8bcd-a96a57497617 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.143784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc728c2-e4f7-4e90-8bcd-a96a57497617 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.143860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc728c2-e4f7-4e90-8bcd-a96a57497617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.160967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bfc728c2-e4f7-4e90-8bcd-a96a57497617 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:24.162183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bfc728c2-e4f7-4e90-8bcd-a96a57497617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:24.241870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 460/926] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:24.257995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909292e-521b-44f1-a0d1-e3eacb0fe9bd None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.304798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a682e7-aa4c-40f3-9cfc-ee5599696347 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.305418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a682e7-aa4c-40f3-9cfc-ee5599696347 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.305971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a682e7-aa4c-40f3-9cfc-ee5599696347 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.307940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 461/927] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:24.313788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.314337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.314817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.337162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:24.338707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:24.368325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909292e-521b-44f1-a0d1-e3eacb0fe9bd None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.402977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.404052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.404551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.405039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.405928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.407517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.419062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 25 03:12:24.421534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 467/928] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:24.426977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 462/929] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:24.433694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.451610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.528454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb1e7-ed0a-4f57-9f28-9b99faeeb3e6 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.554019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc52fda-9a8e-4b18-96ca-85704b7c83a7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.562461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.563412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.563875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.564322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.565185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:24.565686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.567255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.577515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 468/930] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:24.578940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.590867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.592230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.592693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.593113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.603810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:24.611476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:24.617783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 463/931] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:24.618854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.683326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812a5e-4ff9-4595-b293-d91b5bf7e288 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.718495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.719395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.719823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.720266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.721108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:24.721552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.723079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.727829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca4ae-669a-4718-aff8-44227c299275 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.733758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 469/932] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:24.734953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.763615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.764319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.764603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.764879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.765616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:24.765989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.767385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.780921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 464/933] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:24.781749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.835829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f59d8-e67d-4b01-bfec-b5861df62956 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.871581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.872545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.872972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.873419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.874403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] RBAC: Adding query filter params (interface=public, service_id=7a114abdca5040de94f4a3445fef2a8e, region_id=RegionOne) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:24.874941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.876506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.882742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 470/934] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/endpoints?service_id=7a114abdca5040de94f4a3445fef2a8e&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:24.889200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:24.895613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bd73-2a02-434a-b30c-72c82000e750 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:24.936365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:24.937393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:24.937875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:24.938317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:24.951666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:24.953313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:24.975160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:24.977937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 465/935] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:24.982802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.015292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d43ff8-5ae1-45da-a1cb-4e1914c54b87 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.049913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.050778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.051226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.051641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.052517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.054131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.060660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 471/936] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:12:25.105282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffac22-d0d6-4700-a3d3-901451253eb4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.143534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.144322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.144548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.144833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.145565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:25.145895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.147322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67763-66d4-4b90-bddc-00ee1760a592 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.161946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 466/937] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:25.167607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.242572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a3510-af3d-42ef-a2f5-f85551ae2f58 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.242931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a3510-af3d-42ef-a2f5-f85551ae2f58 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.243095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a3510-af3d-42ef-a2f5-f85551ae2f58 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.245183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 467/938] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:25.251237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.251580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.251788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.271054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:25.272218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:25.277697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60c1f-8ad8-486f-a8bf-2238e7f53834 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.319992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.320750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.321032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.321308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.331109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.332619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.347594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:25.349197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 472/939] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:25.352958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 468/940] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:25.357699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.377384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.473259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c3b1-5611-4cf2-b0cc-ce3a4307c04a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.487775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644cdd-f14f-4bd6-ba7e-08b1507d2052 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.508864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.509547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.509878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.510110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.510956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:25.511259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.512812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.528047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.529756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.530244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.530726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.531583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.537564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 473/941] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:25.538013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.538908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.550612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 25 03:12:25.556944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 469/942] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:25.557971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.642070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f5d4-0999-4690-aa54-a52fff12e3ea None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.658940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccce0-da2e-4875-8d23-ac0d6e7fc03d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.676205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.677021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.677324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.677570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.687574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.689055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.697800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.698749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.699240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.699724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.700728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:25.701232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.702864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.706692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:25.712543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 474/943] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:25.712668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 470/944] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:25.715267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.716958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:25.833744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81fcac-3ea9-4517-ab9a-a7ede0de2d02 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.843775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87959d-1cdd-4e3b-bd34-bf4bb68d9586 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:25.869208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.869904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.870182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.870447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.871139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:25.871437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.872854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82138f-1218-4518-8201-a22dac4f1896 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.881702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 471/945] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:25.881702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d25cf-04bf-4602-9a80-05f788dd9129 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.881702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d25cf-04bf-4602-9a80-05f788dd9129 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.881702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d25cf-04bf-4602-9a80-05f788dd9129 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.881702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 472/946] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:25.886508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.886979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.887080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.901575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:25.902203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:25.902482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:25.902753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:25.903470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:25.904513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:25.905982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:25.919466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:25.919466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:25.923524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 475/947] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:25.928892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.017748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 473/948] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:26.040143 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.070125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee079-296a-4e4b-9d3e-3a228f5efa65 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.105022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.106239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.107302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.107779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.115008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.116688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.131203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:26.132981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 476/949] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:26.138374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.151995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13bbcb-d174-43c4-8ba5-c296c4175cc6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.188145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.188859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.189176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.189410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.190199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.191651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.192990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.common [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 25 03:12:26.245490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d6f-bbad-4e05-8b73-661449e2853c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.254125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.sql.core [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 25 03:12:26.254125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 25 03:12:26.254125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [parameters: {'id': '51f95ed7b6824ce8a3d63c18d90cdca6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 25 03:12:26.254125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 25 03:12:26.261234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51f95ed7b6824ce8a3d63c18d90cdca6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51f95ed7b6824ce8a3d63c18d90cdca6. Mar 25 03:12:26.267886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 474/950] 10.222.0.24 () {60 vars in 1140 bytes} [Fri Mar 25 03:12:26 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:26.269339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.283324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.283974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.284418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.284847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.285793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:26.286242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.287945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.300810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 477/951] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:26.306396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.377122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ddb4-40a7-472c-8762-c820b92ca95f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.409693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb32fb-875e-41bb-adb8-3a19d8393976 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.411358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.412369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.412874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.413347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.420894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.422820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.436620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:26.438353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 475/952] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:26.443651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:26.444344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.445394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.445756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.446035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/c1ad3502a895428e96aa792a5c54cba1/roles/3a8e89905f894a3caeea6627c55420cc` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.449231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=c1ad3502a895428e96aa792a5c54cba1, role_id=3a8e89905f894a3caeea6627c55420cc)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.450810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446249-d096-4b71-a72d-68322e010f38 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.542383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c31a-47c8-4511-9595-801a83581919 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:26.558129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 478/953] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:26 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/c1ad3502a895428e96aa792a5c54cba1/roles/3a8e89905f894a3caeea6627c55420cc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:12:26.589062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:26.589832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:26.590170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:26.590504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:26.591956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:26.592378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:26.594042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036bfcf-8001-4d1d-a7ce-d47694f207a9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:26.617705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 476/954] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:27.440876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de115-01a9-43cb-b9a9-090916b8be3c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:27.441425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de115-01a9-43cb-b9a9-090916b8be3c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:27.441425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de115-01a9-43cb-b9a9-090916b8be3c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:27.443384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 479/955] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:27.448933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227f99-7596-4796-8095-832642eb762e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:27.449752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227f99-7596-4796-8095-832642eb762e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:27.450252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d227f99-7596-4796-8095-832642eb762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:27.470556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9d227f99-7596-4796-8095-832642eb762e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:27.472407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9d227f99-7596-4796-8095-832642eb762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:27.545815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 477/956] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:27.565454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de115-01a9-43cb-b9a9-090916b8be3c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:27.675767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de115-01a9-43cb-b9a9-090916b8be3c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:27.711507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:27.712641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:27.713135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:27.713600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:27.714487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:27.716117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:27.728187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 25 03:12:27.733787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 480/957] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:27.736784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d227f99-7596-4796-8095-832642eb762e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:27.837319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d227f99-7596-4796-8095-832642eb762e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:27.875017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:27.876088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:27.876569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:27.877039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:27.878048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:27.878607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:27.880334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:27.889799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 478/958] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:27.892958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:27.994888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c7c6-b726-464f-8fc3-96fdaee5efd5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:28.027787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:28.028439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.029238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.029513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.030237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:28.030535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:28.031898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e26c7-64f4-41e0-a480-c070ebdccbdb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:28.041410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 481/959] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:28.042778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:28.143638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e063bf-2b8f-4944-8414-cba8fbb78173 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:28.178069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:28.178725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.179006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.179278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.180021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:28.181409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:28.246007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44690-adc0-457a-8b4e-d1a8874225bf None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.246338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44690-adc0-457a-8b4e-d1a8874225bf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.246652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44690-adc0-457a-8b4e-d1a8874225bf None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.248993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 482/960] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:28.254351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd340-02c7-42dd-bd72-2777d900036b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.254822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd340-02c7-42dd-bd72-2777d900036b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.255487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd340-02c7-42dd-bd72-2777d900036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.261286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 479/961] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:28.279460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-778cd340-02c7-42dd-bd72-2777d900036b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:28.282741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-778cd340-02c7-42dd-bd72-2777d900036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:28.368396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 483/962] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:28.391575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:28.503599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a81f6-e005-44d3-8653-b1644c21822c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:28.537044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:28.537749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.538037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.538310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.539095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:28.540547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc93456-4077-4349-b8a7-05e9372c004f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:28.616148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 480/963] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:28 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:28.938400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677bb4-46f8-4a8b-906e-af63d3a8d85c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.939414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677bb4-46f8-4a8b-906e-af63d3a8d85c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.939928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677bb4-46f8-4a8b-906e-af63d3a8d85c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.942187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 484/964] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:28.947503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea9c51-47ea-4b08-b56a-c3866cb72b6d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:28.948018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea9c51-47ea-4b08-b56a-c3866cb72b6d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:28.948494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea9c51-47ea-4b08-b56a-c3866cb72b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:28.967514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-71ea9c51-47ea-4b08-b56a-c3866cb72b6d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:28.968956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-71ea9c51-47ea-4b08-b56a-c3866cb72b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:29.048913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 481/965] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:29.072454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06677bb4-46f8-4a8b-906e-af63d3a8d85c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.081741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db106-fe47-47e4-964b-f111c0e74f3f None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.082039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db106-fe47-47e4-964b-f111c0e74f3f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.082323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db106-fe47-47e4-964b-f111c0e74f3f None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.084376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 482/966] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:29.089202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919520-9ac5-4146-a433-79831761ec33 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.089490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919520-9ac5-4146-a433-79831761ec33 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.089809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919520-9ac5-4146-a433-79831761ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.108485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-44919520-9ac5-4146-a433-79831761ec33 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:29.109702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-44919520-9ac5-4146-a433-79831761ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:29.181748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 483/967] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:29.199233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06677bb4-46f8-4a8b-906e-af63d3a8d85c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.202739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919520-9ac5-4146-a433-79831761ec33 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.242360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.243432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.244284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.244705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.258157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:29.268155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:29.270104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 485/968] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:29.275940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.308860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919520-9ac5-4146-a433-79831761ec33 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.344609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.345639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.346177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.346659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.347559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.349253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.390920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.sql.core [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 25 03:12:29.390920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 25 03:12:29.390920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [parameters: {'user_id': '2d77e012fdbf49feb45a9f0de9a97bf9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 25 03:12:29.390920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 25 03:12:29.396756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 25 03:12:29.397924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab01f7-4baf-49ad-bdcd-979a767c3d1a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.404148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 484/969] 10.222.0.24 () {60 vars in 1131 bytes} [Fri Mar 25 03:12:29 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:29.409998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.447651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.449366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.449605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.449910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.450685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:29.450987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.452358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.461704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 486/970] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:29.467950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.521394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ddea-4d29-4d3f-8c11-f65795173ef2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.555779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.556803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.557255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.557694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.565787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.567608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.571585 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149bda-65de-4af1-bf07-027342d6a386 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.581854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 25 03:12:29.583486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 485/971] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:29.588763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.609880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.610919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.611401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.611846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.623293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.625013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.641951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:29.647909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 487/972] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:29.648925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.707906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46ef1-9f89-4a0b-b65f-24e907dfb3ab None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.753909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182317-f81f-4ab8-a80b-f5e770d09fac None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.754540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.754900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.755195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.755471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.756273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:29.756577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.759048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.794872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.795806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.796269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.796704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.797584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:29.798129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:29.800315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:29.812812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 486/973] 10.222.0.24 () {56 vars in 1101 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:29.819154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 488/974] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:29.835675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:29.939908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9ae5-efb6-4342-9a4f-2568697c7051 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:29.988712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:29.989540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:29.989867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:29.990148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:29.998763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.000257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.016167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 25 03:12:30.021858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 487/975] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:30.024112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.127317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327922e1-d741-4694-877b-1c4fe4eb4192 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.161873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.162544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.162828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.163103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.163996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:30.164306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.165812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.182944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 489/976] 10.222.0.24 () {56 vars in 1149 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:30.189238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.288859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271e6a6-3fae-4941-a679-4c042265bd7f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.325263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.326765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.327057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.327343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.392080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.393561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab8b00-99f5-4e8a-959b-7050b55f9b23 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.492320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 488/977] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 25 03:12:30.493950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.591120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1c94e-91e6-402b-ae1b-800fab44e8ce None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.628655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.629442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.629758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.630025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.640290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.641818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.658100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:30.663707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 490/978] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:30.663835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371599de-e794-4921-a73e-b19366d3d361 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.663835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371599de-e794-4921-a73e-b19366d3d361 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.663835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371599de-e794-4921-a73e-b19366d3d361 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.663835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 489/979] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:30.664620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.668015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.668297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.668572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.686728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:30.688222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:30.754306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 490/980] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:30.764790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8911d4c-4f59-43d9-912d-d291c8e208cf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.776636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.799463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.800408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.800689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.800960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.801689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:30.801996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.803356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.818996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 491/981] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:30.820287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.874781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cf65c-5c95-4920-8a65-1990653c40e1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.907689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.908485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.908761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.909029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.909687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.911202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.922702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 25 03:12:30.922841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef37a6-6030-4396-913e-d37c8dbb4255 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:30.924088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 491/982] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:30.929501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:30.961436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:30.962286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.962569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.963027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.969886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:30.971338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:30.984654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-52cd894b-4284-4a31-8551-fedff666e45a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:30.985838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 492/983] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:30.987108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763dd7e-b559-48bf-9f40-cc8e7c474f4f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:30.987394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763dd7e-b559-48bf-9f40-cc8e7c474f4f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:30.987668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763dd7e-b559-48bf-9f40-cc8e7c474f4f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:30.989302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 493/984] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:30.991185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763dd7e-b559-48bf-9f40-cc8e7c474f4f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.033698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee297d-e071-4fdf-a0f2-bb33f5e0540b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.065685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.066353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.066634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.066907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.067596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.067894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.069271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b64ad-4b4f-4961-945f-3ad000c3b6f0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.074218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 492/985] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:31.075276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.076121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.076399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.089089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763dd7e-b559-48bf-9f40-cc8e7c474f4f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.092474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:31.093716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:31.121572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.122845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.123129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.123400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.124174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.124479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.125975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.137017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 494/986] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:31.137860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.158019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 493/987] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:31.158841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.231246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058a39-4b8b-429e-abf6-10df496e7997 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.251998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044632c5-5c91-49e1-a6c0-94a0a9e45b83 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.263718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.264376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.264654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.264927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.265616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.265958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.267326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.271868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 495/988] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:31.272628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.284081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.284731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.285013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.285289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.286133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] RBAC: Adding query filter params (role.id=3a8e89905f894a3caeea6627c55420cc, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=c1ad3502a895428e96aa792a5c54cba1) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.286440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.287894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.305695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 494/989] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/role_assignments?user.id=c1ad3502a895428e96aa792a5c54cba1&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=3a8e89905f894a3caeea6627c55420cc => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:31.305695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.382580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf9df-3dc8-4dac-9677-fc9410668609 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.401211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c428-ea86-431d-a3fe-d50f32f8a806 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.417862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.418693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.419520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.419721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.420383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.421824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.435928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 25 03:12:31.437459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 496/990] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:31.441226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.441939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.442221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.442507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.443342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] RBAC: Adding query filter params (interface=admin, service_id=7a114abdca5040de94f4a3445fef2a8e, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.443711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.444277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.445130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.450910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 495/991] 10.222.0.24 () {56 vars in 1249 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/endpoints?service_id=7a114abdca5040de94f4a3445fef2a8e&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:31.457110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.551964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef12f8-8ad7-4822-8b22-a8ef9891a4d1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.560339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e21b1-ab01-45c0-8eba-37be6141dccd None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.584902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.585558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.585873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.586150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.586844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.587323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.588609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.593988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 497/992] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:31.597763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.598575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.598861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.599134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.599287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.599805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.601176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.608135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 496/993] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:12:31.713912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4f81-3bef-4b6a-8074-4e36417b6d94 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.748601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.749263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.749540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.749845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.750543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.750841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.752209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.763925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 498/994] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:31.764126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:31.864818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70ccd-db82-4139-a560-20f1b2db4861 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:31.898161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:31.898819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:31.899099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:31.899372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:31.900145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] RBAC: Adding query filter params (interface=public, service_id=7d7f00443ee44bdeb942d0f8446f4a35, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:31.900450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:31.901849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6312e-c803-47c3-9d4c-643074049f03 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:31.908564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 497/995] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/endpoints?service_id=7d7f00443ee44bdeb942d0f8446f4a35&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:31.913400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:32.015856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5b88-2392-4867-b5fa-de669ab146a7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:32.048716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:32.049375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:32.049671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:32.049962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:32.050637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:32.052066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da0a0-682d-4fd0-9d96-93f71473a3ea None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:32.058136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 499/996] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:31 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:12:33.613964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce69d-c07e-4666-9c22-34c955407396 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:33.614483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce69d-c07e-4666-9c22-34c955407396 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:33.614483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce69d-c07e-4666-9c22-34c955407396 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:33.616314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 498/997] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:33.621274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:33.621786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:33.621877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:33.638903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:33.640059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:33.703837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 500/998] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:33.725513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ce69d-c07e-4666-9c22-34c955407396 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:33.821636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ce69d-c07e-4666-9c22-34c955407396 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:33.854635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:33.855412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:33.855689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:33.855958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] PATH_INFO: `/v3/services/image` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:33.856616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:33.858019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:33.868490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2538758c-82f5-4053-97f6-2359d1b66e65 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 25 03:12:33.869785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 499/999] 10.222.0.24 () {56 vars in 1105 bytes} [Fri Mar 25 03:12:33 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:33.876029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:33.905742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40836-6f9d-4de8-94fc-a0847b85fe85 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:33.906106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40836-6f9d-4de8-94fc-a0847b85fe85 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:33.906303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40836-6f9d-4de8-94fc-a0847b85fe85 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:33.908205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 500/1000] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:33.912884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:33.913169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:33.913445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:33.929904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:33.931284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:33.976271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4da1-9f50-46b6-b1d2-2c5449a7b285 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.001720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 501/1001] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:34.013598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.014352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.014634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.014907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.015640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] RBAC: Adding query filter params (name=image) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.015947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.017319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.022017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 501/1002] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:34.028039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.028188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.125308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed42f5-1ca1-4884-8f35-c2ec496962ad None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.125486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a21047-b672-44ea-98c9-3ad28018611b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.157697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372675bd-f98e-4861-adab-59469035f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.158349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372675bd-f98e-4861-adab-59469035f793 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.158509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.158941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372675bd-f98e-4861-adab-59469035f793 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.159271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.159507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372675bd-f98e-4861-adab-59469035f793 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.159620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.159804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.160432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.160733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372675bd-f98e-4861-adab-59469035f793 None admin] RBAC: Adding query filter params (type=image) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.161174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372675bd-f98e-4861-adab-59469035f793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.161801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.162870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372675bd-f98e-4861-adab-59469035f793 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.167525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 502/1003] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:34.179188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 25 03:12:34.180460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 502/1004] 10.222.0.24 () {56 vars in 1126 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:34.187189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372675bd-f98e-4861-adab-59469035f793 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.289097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372675bd-f98e-4861-adab-59469035f793 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.325248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.325955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.326237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.326507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.327270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.327575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.328969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe1637-f1a1-40f6-8ba0-93938035468c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.337948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 503/1005] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:34.341324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.346902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd2a5-404b-447c-8561-43dbd840157d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.348326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd2a5-404b-447c-8561-43dbd840157d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.348326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd2a5-404b-447c-8561-43dbd840157d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.349345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 504/1006] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:34.354343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.354486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.354723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.373259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:34.374699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:34.440400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 505/1007] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:34.441781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d239-6aa6-4151-afe6-9aec9668fa30 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.462783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.474951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.475613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.475893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.476164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.476856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.477157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.478556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.483848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 503/1008] 10.222.0.24 () {56 vars in 1122 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:34.489429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.560883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4023-b1e6-4857-b9e4-7d0babfcee18 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.591271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7587a-1e94-4fce-a796-644124865d3c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.594658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.595452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.595730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.596001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.596665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.598064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.609279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 25 03:12:34.610653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 506/1009] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:34.616186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.623744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.624388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.624661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.624934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.625652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.627033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.710455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2353-a70c-4a8c-af3d-01ab8935e5e3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.711427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 504/1010] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:34.753453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.754152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.754431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.754697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.755396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.755692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.757095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.767230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 507/1011] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:34.768295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:34.873697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c7f85-88b1-4d5b-8bf8-332303ffcffc None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:34.908542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:34.909201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:34.909478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:34.909784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:34.910471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:34.910770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:34.912123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6684f4-29f3-4a50-9bd4-d6f9c08a4b8b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:34.917152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 505/1012] 10.222.0.24 () {56 vars in 1112 bytes} [Fri Mar 25 03:12:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:34.922925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:35.022219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd3f34-f3ca-4dd3-ad96-3c10ba05a6d3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:35.054875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:35.055527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:35.055812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:35.056084 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:35.056824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:35.058235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34eb7-8f63-4335-8bff-075b49f8acfc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:35.140413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 508/1013] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:36.494269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd29de-02d2-4a5c-9f74-9f70e632c4ff None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:36.494851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd29de-02d2-4a5c-9f74-9f70e632c4ff None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:36.494851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd29de-02d2-4a5c-9f74-9f70e632c4ff None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:36.496737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 506/1014] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:36.502358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c912-8382-489c-91f7-72eae588f976 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:36.502791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c912-8382-489c-91f7-72eae588f976 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:36.502978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c912-8382-489c-91f7-72eae588f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:36.519823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bac8c912-8382-489c-91f7-72eae588f976 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:36.521024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bac8c912-8382-489c-91f7-72eae588f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:36.591857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 509/1015] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:36.615075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd29de-02d2-4a5c-9f74-9f70e632c4ff None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:36.718820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd29de-02d2-4a5c-9f74-9f70e632c4ff None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:36.752138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:36.752735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:36.753022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:36.753382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:36.754153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:36.755553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0792f-45e3-49fb-9dc4-30c4a3ea2e8f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:36.854486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 507/1016] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:36 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:37.034707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c88f0-de7c-4559-ad7e-614b3848260e None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.034909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c88f0-de7c-4559-ad7e-614b3848260e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.035173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c88f0-de7c-4559-ad7e-614b3848260e None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.036974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 510/1017] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:37.042258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.042746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.043036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.060954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:37.062231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:37.135891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 508/1018] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:37.160422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c88f0-de7c-4559-ad7e-614b3848260e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:37.260443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c88f0-de7c-4559-ad7e-614b3848260e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:37.293012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:37.293777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.294060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.294327 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] PATH_INFO: `/v3/domains/default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.295492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:37.296989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2960c5-a15a-4ef1-a725-96a6380364df None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:37.298822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 511/1019] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:37.304263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:37.397425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97635632-d9ca-4017-8f2d-6b1bf91035fb None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:37.430289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:37.430945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.431228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.431502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.432212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:37.433650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf92d5b-8b18-448a-a3b1-623cc38f6737 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:37.548935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 509/1020] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:12:37 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:37.549894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fef4-a48d-4d81-a531-99b559733f3b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.549894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fef4-a48d-4d81-a531-99b559733f3b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.549894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fef4-a48d-4d81-a531-99b559733f3b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.549894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 512/1021] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:37.551488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.551785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.552115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.570828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:37.572066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:37.644135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 510/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:37.667820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363fef4-a48d-4d81-a531-99b559733f3b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:37.771874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363fef4-a48d-4d81-a531-99b559733f3b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:37.805164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:37.805924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.806204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.806472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.816946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:37.824231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:37.826126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 513/1023] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:37.832542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:37.926705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d908-046c-4476-b205-c40d158f3b94 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:37.960183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:37.960312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:37.960563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:37.960802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:37.961540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:37.961860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:37.963220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:37.976602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 511/1024] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:37.977923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:38.076902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6314f-6455-4f7e-8b39-efa14f804a12 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:38.108553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:38.109331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:38.109607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:38.109902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:38.119946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:38.121380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:38.136924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:38.138789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 514/1025] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:38.144237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:38.237284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a044a-78d0-473f-b03e-9166c3371e28 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:38.269649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:38.270380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:38.270661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:38.270930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:38.271625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:38.271923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:38.273274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:38.284926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 512/1026] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:38.290251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:38.394385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da4d7c-b511-4ef3-99b3-f23cbcad6fd2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:38.425987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:38.426819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:38.427095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:38.427363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:38.437686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:38.437686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:38.451641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:12:38.457603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 515/1027] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:12:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:38.458995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:38.553732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a851-38cb-41ed-812a-f7c786ad0b68 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:38.587516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:38.588200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:38.588483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:38.588753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:38.589598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:38.589935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:38.591386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:38.612945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 513/1028] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:12:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:38.614414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:38.712021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e31981-3df5-42f9-af08-60da41d7d144 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:38.744829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:38.745475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:38.745786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:38.746064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:38.811014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:38.812534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:38.911435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 516/1029] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 25 03:12:38.917110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.020358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f88ed-c3e2-4b70-8143-640587f0e216 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.054136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.054911 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.055188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.055453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.065804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.067246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.084560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-e5cc0396-fc99-47d5-a012-68dbd6e7f2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:39.085909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 514/1030] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:39.091394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.187069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b54d08-47a7-45f0-a02c-7e0cc15f37fc None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.190943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926fcf-a678-413a-a765-ef74a5eab25f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.191226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926fcf-a678-413a-a765-ef74a5eab25f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.191499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926fcf-a678-413a-a765-ef74a5eab25f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.193501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 515/1031] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:39.198187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.198466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.198740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.215993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:39.217173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:39.221040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.221714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.221996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.222262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.222962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.223257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.224617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.239946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 517/1032] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.240963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.286618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 516/1033] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:39.308588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.340034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3205b6b-cc9d-474f-bb32-c3ed92db563e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.373570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.374427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.374709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.374977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.382872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.384737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.402048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:39.403448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 518/1034] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:39.407159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e6cfb-388c-44f6-9fbc-721e3ab30b4a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.408768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.441192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.442007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.442291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.442570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] PATH_INFO: `/v3/services/image` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.443209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.444583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.455139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 25 03:12:39.456721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 517/1035] 10.222.0.24 () {56 vars in 1105 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:39.462302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.506659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ca0ff-a84c-40c7-a727-9a65ce2a578b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.545757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.546345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.546618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.546882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.547652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.547952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.549397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.561628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 519/1036] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.562005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e5de-bfe7-469e-9928-b86655832c76 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.567319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.596146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.596799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.597077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.597349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.598072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] RBAC: Adding query filter params (name=image) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.598426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.599784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.604507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 518/1037] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.609859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.664591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51f48-3c80-4094-94bc-d05df3f2b0f7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.697624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.698293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.698742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.699193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.700533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] RBAC: Adding query filter params (role.id=3a8e89905f894a3caeea6627c55420cc, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.701042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.702497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.705769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbfe9-bdc6-437d-abda-e265d0b8fa90 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.708429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 520/1038] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=3a8e89905f894a3caeea6627c55420cc => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.741473 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.742180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.742458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.742725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.743430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] RBAC: Adding query filter params (type=image) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.743731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.745128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86954b8-27dd-4e44-8f43-53dbf897b611 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.755519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 519/1039] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.756605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.866851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12a4b9-33b3-4d8d-989a-c94c9b365c5a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:39.888162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4304d0-fb53-44ca-9775-c7d9f3cf316e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.888443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4304d0-fb53-44ca-9775-c7d9f3cf316e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.888712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4304d0-fb53-44ca-9775-c7d9f3cf316e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.890507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 520/1040] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:39.896627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.896913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.897184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.901468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:39.902150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:39.902427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:39.902697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:39.904003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] RBAC: Adding query filter params (interface=public, service_id=7060768417a847248ce1c76a90ee59b3, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:39.904306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:39.905705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:39.910919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 521/1041] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/endpoints?service_id=7060768417a847248ce1c76a90ee59b3&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:39.915014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:39.916035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:39.916417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:39.987687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 521/1042] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:40.011647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:40.016113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9c5e-4ad5-46df-b09c-11d1986011a0 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:40.049816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:40.050570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:40.050849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:40.051124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:40.051788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:40.053221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:40.059812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 522/1043] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:12:39 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:12:40.123655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dca16-10e1-4172-872c-13b2f48fef93 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:40.159079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:40.159882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:40.160162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:40.160431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:40.161633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:40.163111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58950b21-0bb3-47a2-9f48-510353f91005 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:40.164907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 522/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:40.170485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:40.271685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64170b-4588-407f-8e60-6a81bc02e1db None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:40.304027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:40.304697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:40.304978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:40.305255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:40.306003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:40.307444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a7f68-70fe-426a-a4ae-fe6ba8538216 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:40.442804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 523/1045] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:12:40 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:42.004262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baba7-60f5-477a-b513-cae09665da5a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.004790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baba7-60f5-477a-b513-cae09665da5a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.004790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baba7-60f5-477a-b513-cae09665da5a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.006667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 523/1046] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:42.013163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.013713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.013821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.030383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:42.031565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:42.095859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 524/1047] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:42.118390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4baba7-60f5-477a-b513-cae09665da5a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.216107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4baba7-60f5-477a-b513-cae09665da5a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.248772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.249570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.249880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.250152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.259920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:42.267685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-35fde9ba-fca6-406c-b80d-35239c59f70f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:42.269024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 524/1048] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:42.274692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.352118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a348-a130-4c64-8976-9d72b4df6b6f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.353704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a348-a130-4c64-8976-9d72b4df6b6f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.353704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a348-a130-4c64-8976-9d72b4df6b6f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.354421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 525/1049] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:12:42.359979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.360259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.360527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.369643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12bf12-b298-4cb1-801b-535caea09577 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.377520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:42.378728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:42.404179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.404829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.405098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.405367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.406200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:42.406499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.407872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.421731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 525/1050] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:42.422889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.453722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 526/1051] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:42.471317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.523098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11aad-d62c-4b54-b587-a4c09e25f4f1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.555599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.556381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.556657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.556921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.566665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5817254-8a5b-43af-b238-4ddef7968e4b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.568049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.569438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.585597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:42.586951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 526/1052] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:42.592211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.601551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.602358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.602635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.602898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] PATH_INFO: `/v3/services/image` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.603535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.604889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.616043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 25 03:12:42.617329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 527/1053] 10.222.0.24 () {56 vars in 1105 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:42.623423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.688748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b295-cd1e-4a70-ae05-3e4840da19e9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.718821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4595c1-7b78-4d7b-b003-6dfc65f06aa5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.721067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.721801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.722242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.722513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.723208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:42.723506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.724875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.737013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 527/1054] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:42.742244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.751633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.752297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.752578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.752852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.753552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:42.753900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.755268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.760170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 528/1055] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:42.765965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.836365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf29fa-e6ce-4d53-80e1-766038c8bee9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.860533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5067-bfc2-4691-b234-a0550db50fc0 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:42.868622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.869396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.869694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.869968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.876658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.878133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.891386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-f08af097-e70f-44ee-a4e3-baa8ffa626c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:12:42.892563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 528/1056] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:42.894552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:42.895574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.895679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc004d-10ac-4d88-a500-bc99d25ed19a None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.896016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.896115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc004d-10ac-4d88-a500-bc99d25ed19a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.896447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.896543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc004d-10ac-4d88-a500-bc99d25ed19a None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.897635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] RBAC: Adding query filter params (type=image) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:42.898148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:42.901182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 529/1057] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:42.901367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc8fe7-b475-44c0-b5fe-6ba9202849ff None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:42.901524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc004d-10ac-4d88-a500-bc99d25ed19a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:42.908422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 529/1058] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:42.910370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:42.910822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:42.911263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:42.930661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:42.931823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:42.995578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 530/1059] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:42.996363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.009965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc004d-10ac-4d88-a500-bc99d25ed19a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.043053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.044313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.044537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.044804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.045610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:43.045938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.047532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.065172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 530/1060] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:12:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:43.066003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.091137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bba7-be56-421a-a08a-551c0423ba75 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.122606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.123246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.123528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.123804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.124520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.125899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.160239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81db3-bf80-4b82-a81a-4b29ead736aa None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.191860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.192628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.192902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.193169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.203263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:43.210341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:43.211494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 531/1061] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:43.212345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.241603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 531/1062] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:12:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:12:43.241603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.316144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07697f-970f-4f3f-9a44-81c74423c0a2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.347042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f097-58b1-4369-9dd0-94275f43b703 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.352235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.352395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.352592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.352840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.364488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.366007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.383120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.383395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:43.383786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.384063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.390018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.390202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 532/1063] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:43.390324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:43.390324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.390324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.391139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.397207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 532/1064] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:43.403937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.499953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367706-fbd5-48ad-b21b-c730d791861b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.510131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f6f34-c134-4b85-b2f3-47b924b287e9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.533239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.533949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.534224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.534500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.535241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:43.535546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.536967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.544015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.545156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.545488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.545801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] PATH_INFO: `/v3/users/bf42a4daad97487b9437da116124d33b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.548951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 533/1065] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:43.554340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.560782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=bf42a4daad97487b9437da116124d33b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.562278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.564118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 533/1066] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/users/bf42a4daad97487b9437da116124d33b => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:43.569406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.649552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7949b-ef8f-48b8-8470-bf437ce98c00 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.672208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fb735-a345-4831-b7db-1c970f40bbe1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.683889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.685754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.686608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.687395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.695506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.697052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.705749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.706381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.706654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.706920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.711799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:43.717784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 534/1067] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:43.718793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.772996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.774480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.815269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f54a4-17e9-4a56-82ab-0e0fcdac47b4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.848103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.848753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.849027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:43.849293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:43.850087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:43.850388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:43.851822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:43.864319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 535/1068] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:43.869651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.873711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 534/1069] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:43.876414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:43.964343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0e9f-c18b-4d52-8629-c8b73f2b9cce None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.970512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e1c0-67bc-4a3c-b16b-5830b77004ee None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:43.998693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:43.999571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:43.999848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:44.000114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/3a8e89905f894a3caeea6627c55420cc` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:44.002322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=ba728b1294014f94b7acab7ccf594ce7, role_id=3a8e89905f894a3caeea6627c55420cc)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:44.003746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506750e-f6bc-46ff-af21-cc907ef58df0 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:44.004556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:44.005440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:44.005757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:44.006039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:44.007259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:44.008684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:44.010429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 535/1070] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:12:43 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:44.016409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:44.088412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 536/1071] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:43 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/ba728b1294014f94b7acab7ccf594ce7/roles/3a8e89905f894a3caeea6627c55420cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:12:44.116455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fe1ef-e650-47ba-92b7-a5903f1ab3a7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:44.153604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:44.154372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:44.154652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:44.154986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:44.155833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=2eed4fccf56248f98f80122ac4797a38, user.id=bf42a4daad97487b9437da116124d33b) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:44.156145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:44.157596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77595b-9204-4b03-af00-760369b2aaad None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:44.163953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 536/1072] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:44 2022] GET /identity/v3/role_assignments?user.id=bf42a4daad97487b9437da116124d33b&scope.project.id=2eed4fccf56248f98f80122ac4797a38&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:45.573239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4cdea-454e-41b5-a9e9-ef87061a59cc None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:45.574028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4cdea-454e-41b5-a9e9-ef87061a59cc None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:45.574028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4cdea-454e-41b5-a9e9-ef87061a59cc None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:45.575909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 537/1073] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:45.581113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:45.581542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:45.581786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:45.597951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:45.599122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:45.663303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 537/1074] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:45.686009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4cdea-454e-41b5-a9e9-ef87061a59cc None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:45.783444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4cdea-454e-41b5-a9e9-ef87061a59cc None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:45.815947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:45.816597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:45.816876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:45.817148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:45.881930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:45.883385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:45.990055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 538/1075] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 25 03:12:45.991313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.102631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f76ae9-2e4b-47f4-9a0c-b095469d7e89 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.136751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.137492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.137804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.138082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.147994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.149444 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.165974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-4db308a1-bef8-4318-b328-0b6d80e5fa79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:46.167315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 538/1076] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:46.173529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.268063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac372a-20a8-46bd-8c2f-82806bbb77a2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.300785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.301447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.301754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.302033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.302741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:46.303040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.304406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4495d-5cad-4700-a9fd-87d576a4f0cc None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.321698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 539/1077] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:46.407866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c599b-ef60-4217-af5f-de6c9c2fc817 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.408043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c599b-ef60-4217-af5f-de6c9c2fc817 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.408312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c599b-ef60-4217-af5f-de6c9c2fc817 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.410354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 539/1078] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:46.415796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.416085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.416363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.435026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:46.435984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6326-f7cd-49cc-b0eb-2894801761ed None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.436252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:46.436356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6326-f7cd-49cc-b0eb-2894801761ed None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.436514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6326-f7cd-49cc-b0eb-2894801761ed None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.441745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 540/1079] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:46.444263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.444557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.444834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.463265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:46.464478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:46.507968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 540/1080] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:46.531864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.534778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 541/1081] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:46.558225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.633514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f555f-990f-4aef-a712-f0981df86725 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.663487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7a27-4b7a-4658-99fb-6f86f70e5ec5 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.666240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.667097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.667382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.667654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.677926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:46.685257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 25 03:12:46.686457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 541/1082] 10.222.0.24 () {56 vars in 1120 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:46.692212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.695471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.696255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.696537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.696810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.706877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:46.713604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:46.714792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 542/1083] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:46.720990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.785258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb229-ac3c-421c-b4d1-2bbd8aa3ab5a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.813681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c099d0-790e-470d-8944-1077af8fb8c8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.816711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.817361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.817640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.817944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.818670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:46.818973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.820366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.828470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 542/1084] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:46.834220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.846480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.847132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.847416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.847689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.848421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:46.848731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.850135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.857955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 543/1085] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:46.863773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:46.927151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de47e6d-536e-4d3d-a7de-d8fde2a038bb None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.955964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecff04-f663-4f35-9306-0f96071f196c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:46.962096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.962882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.963159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.963431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.976575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.978080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.987950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:46.988801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:46.989081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:46.989349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] PATH_INFO: `/v3/users/bf42a4daad97487b9437da116124d33b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:46.990670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] RBAC: Authorizing `identity:get_user(user_id=bf42a4daad97487b9437da116124d33b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:46.992075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:46.993684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 544/1086] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/users/bf42a4daad97487b9437da116124d33b => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:46.994094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:46.998028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 543/1087] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:46.999334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.000600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.091970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb13a-d1fc-4cfe-a391-27f96e453686 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.094333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71545-3d06-4c26-b91a-2dfdff17751d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.123855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.124677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.124956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.125223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.126367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.126501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.127003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.127283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.127557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.127907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.128257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:47.128558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.129605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 545/1088] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:47.129948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.135298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.141516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 544/1089] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:47.148004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.229552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3df96-f518-4cc1-88d0-5c27a4e69751 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.240754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dfe35-143f-4a88-9754-73d8f1f6fea3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.261366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.262297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.262584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.262856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38/users/bf42a4daad97487b9437da116124d33b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.264821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eed4fccf56248f98f80122ac4797a38, user_id=bf42a4daad97487b9437da116124d33b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.266285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.273222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.274033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.274313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.274584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.282071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.283584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.297191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 25 03:12:47.298363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 545/1090] 10.222.0.24 () {56 vars in 1093 bytes} [Fri Mar 25 03:12:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:12:47.303784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.339402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 546/1091] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:47 2022] PUT /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38/users/bf42a4daad97487b9437da116124d33b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:12:47.402136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf027f12-21ba-48a8-96af-cf6c39c105d2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.437773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.438456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.438744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.439017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.439856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:47.440163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.441623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.460153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 546/1092] 10.222.0.24 () {56 vars in 1133 bytes} [Fri Mar 25 03:12:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:47.466716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.568078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312767a0-502f-4381-aeab-c255f60b74b5 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.600800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.601436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.601745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.602018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.665300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.666783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.758925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 547/1093] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:47.765149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:47.859068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30902-1b68-4e0d-bd64-69a21fc8bea3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:47.893691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:47.894491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:47.894769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:47.895040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:47.905263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:47.906749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:47.922721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:12:47.923853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 547/1094] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:47.929314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:48.025977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2032cf-6247-4f3c-9339-e4903f11fcf9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:48.057414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:48.058091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:48.058374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:48.058645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:48.059924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:48.060227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:48.061584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:48.072324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 548/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:48.078290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:48.172696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa334007-c2f1-465a-91ec-4862b764d3c7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:48.206893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:48.207671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:48.207949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:48.208220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:48.214638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:48.216639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:48.229091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:12:48.230277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 548/1096] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:48.236628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:48.330621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86228-21eb-496a-96e3-a92c0f943900 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:48.362346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:48.362990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:48.363268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:48.363537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:48.364298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:48.364601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:48.366106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac79e9-c507-4d2e-a71f-2e1be7cb3288 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:48.377723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 549/1097] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:48.383485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:48.480342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8470-d2c9-434e-94c8-de452f470c4a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:48.511555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:48.512710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:48.512985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:48.513300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:48.514155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] RBAC: Adding query filter params (role.id=3a8e89905f894a3caeea6627c55420cc, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=ba728b1294014f94b7acab7ccf594ce7) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:48.514458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:48.515920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eafe31-717e-424a-be61-f23f45012244 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:48.533708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 549/1098] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:48 2022] GET /identity/v3/role_assignments?user.id=ba728b1294014f94b7acab7ccf594ce7&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=3a8e89905f894a3caeea6627c55420cc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:49.599573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7592-cfa2-48e8-be13-1dcd76a6f14e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:49.600130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7592-cfa2-48e8-be13-1dcd76a6f14e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:49.600130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7592-cfa2-48e8-be13-1dcd76a6f14e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:49.601898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 550/1099] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:49.607658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:49.608091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:49.608184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:49.625160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:49.626356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:49.814419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 550/1100] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:12:49.838254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7592-cfa2-48e8-be13-1dcd76a6f14e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:49.933132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7592-cfa2-48e8-be13-1dcd76a6f14e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:49.965631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:49.966430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:49.966712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:49.966983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:49.976709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:12:49.983415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:12:49.984576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 551/1101] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:12:49.990483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:50.081061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50a87-7bcc-4118-9571-e61504567362 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:50.112263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:50.112901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:50.113174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:50.113441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:50.114223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:50.114520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:50.115871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:50.123337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 551/1102] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:50.128688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:50.223951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523970d5-84d8-4358-9086-ead5d3b81f95 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:50.255502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:50.256340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:50.256620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:50.256890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] PATH_INFO: `/v3/users/bf42a4daad97487b9437da116124d33b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:50.258066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] RBAC: Authorizing `identity:get_user(user_id=bf42a4daad97487b9437da116124d33b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:50.259506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:50.261103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 552/1103] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:50 2022] GET /identity/v3/users/bf42a4daad97487b9437da116124d33b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:50.267277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:50.359237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629a6ef-511c-4d9e-aec1-53e21d6eb375 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:50.390393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:50.391009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:50.391284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:50.391555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:50.453801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:50.455229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:50.547606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 552/1104] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:50.553477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:50.646732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e798-9abe-4846-8cea-b785609ba5b8 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:50.677852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:50.678687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:50.678967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:50.679238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:50.680382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:50.681830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bd08a-53bd-42aa-990c-a6208d3845b2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:50.683462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 553/1105] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:12:50 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:50.690030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:50.781902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35215ed6-24e9-4947-a7ff-139299faed8a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:50.812420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:50.812993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:50.813267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:50.813535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:50.814375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=2eed4fccf56248f98f80122ac4797a38, user.id=bf42a4daad97487b9437da116124d33b) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:50.814675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:50.816095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686210-97f2-4480-bf3d-300eaee9cd24 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:50.821482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 553/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:50 2022] GET /identity/v3/role_assignments?user.id=bf42a4daad97487b9437da116124d33b&scope.project.id=2eed4fccf56248f98f80122ac4797a38&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:53.131730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ef7-169f-488d-9bca-d5c44e7ec6b5 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:53.132284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ef7-169f-488d-9bca-d5c44e7ec6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:53.132284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ef7-169f-488d-9bca-d5c44e7ec6b5 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:53.134052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 554/1107] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:53.139357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:53.144170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:53.144170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:53.156396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:53.157545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:53.221355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 554/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:53.245935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e53ef7-169f-488d-9bca-d5c44e7ec6b5 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:53.341468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e53ef7-169f-488d-9bca-d5c44e7ec6b5 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:53.373565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:53.374358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:53.374639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:53.374909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:53.376059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:53.377475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfbf4-44e3-4e10-a9fc-7da1ea46b1e0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:53.379078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 555/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:12:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:12:53.384497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:53.476852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70cf0-ce92-4653-b4a2-4d7f29006dc3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:53.508431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:53.509076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:53.509359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:53.509633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:53.510367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:53.511818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913479-942e-49af-9c51-c0b8e0c5c45c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:53.612760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 555/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:12:53 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:12:55.932617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101ff3-5378-43e6-8a33-25f80b7dc681 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:55.933177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101ff3-5378-43e6-8a33-25f80b7dc681 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:55.933177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101ff3-5378-43e6-8a33-25f80b7dc681 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:55.935602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 556/1111] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:55.940693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:55.941119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:55.941222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:55.957638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:55.959313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:56.020601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 556/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:56.044567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101ff3-5378-43e6-8a33-25f80b7dc681 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:56.139295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101ff3-5378-43e6-8a33-25f80b7dc681 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:56.170153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:56.170978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:56.171255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:56.171521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] PATH_INFO: `/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:56.172945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] RBAC: Authorizing `identity:get_role(role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:56.174325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:56.175642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 557/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:56 2022] GET /identity/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:56.181155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:56.272123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7429e83-37af-4d1b-9e90-739e18ae64a7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:56.303505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:56.304343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:56.304617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:56.304885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] PATH_INFO: `/v3/users/7307b307cce44f26adbc3e49b1c36b14` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:56.316988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] RBAC: Authorizing `identity:get_user(user_id=7307b307cce44f26adbc3e49b1c36b14)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:56.318437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:56.320028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 557/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:56 2022] GET /identity/v3/users/7307b307cce44f26adbc3e49b1c36b14 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:56.325568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:56.417769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2252c6-c81f-441f-8a80-dece9bab8fff None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:56.448411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:56.449046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:56.449321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:56.449591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:56.511950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:56.513363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:56.606211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 558/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:12:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:12:56.612009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:56.703874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c39c0-8376-4993-a123-a830ebe1524f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:56.736384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:56.737214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:56.737490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:56.737785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:56.738916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:56.740348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea0551-37bd-4c49-b14e-8aca8e951f03 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:56.742035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 558/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:12:56 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:56.747962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:56.841806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09456f5-4342-4af9-b910-9deeb7125ffb None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:56.873131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:56.873731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:56.874016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:56.874288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:56.875082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=2eed4fccf56248f98f80122ac4797a38, user.id=7307b307cce44f26adbc3e49b1c36b14) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:12:56.875388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:56.876787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b735e-1d5b-44b1-a077-b105fb7a749a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:56.881921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 559/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:12:56 2022] GET /identity/v3/role_assignments?user.id=7307b307cce44f26adbc3e49b1c36b14&scope.project.id=2eed4fccf56248f98f80122ac4797a38&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:59.108827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b350e8-d786-4164-9167-2ed00b078f26 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.109367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b350e8-d786-4164-9167-2ed00b078f26 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.109367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b350e8-d786-4164-9167-2ed00b078f26 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.111262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 559/1118] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:12:59.116340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.116759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.116868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.132968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:12:59.134164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:12:59.195450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 560/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:12:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:12:59.218572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b350e8-d786-4164-9167-2ed00b078f26 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:59.313867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b350e8-d786-4164-9167-2ed00b078f26 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:59.345718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:59.346546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.346825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.347097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] PATH_INFO: `/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.348536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] RBAC: Authorizing `identity:get_role(role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:59.349932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:59.351253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 560/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:59 2022] GET /identity/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:59.356906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:59.448423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2550-c04a-4029-bd81-a8aacff6de00 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:59.480270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:59.481049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.481324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.481590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] PATH_INFO: `/v3/users/7307b307cce44f26adbc3e49b1c36b14` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.482762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] RBAC: Authorizing `identity:get_user(user_id=7307b307cce44f26adbc3e49b1c36b14)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:59.484167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:59.485734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 561/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:12:59 2022] GET /identity/v3/users/7307b307cce44f26adbc3e49b1c36b14 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:59.491125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:59.583996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf1da-0cc6-44ab-8661-772d14d1e5ad None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:59.615962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:59.617059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.617335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.617606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.619068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:59.620837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5454-f8e8-4d23-88da-d06cf99f1b52 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:59.623117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 561/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:12:59 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:12:59.629017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:12:59.722247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49d83-01cd-48e9-8c54-197e5d23b8fe None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:12:59.754803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:12:59.755612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:12:59.755893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:12:59.756165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38/users/7307b307cce44f26adbc3e49b1c36b14/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:12:59.758325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] RBAC: Authorizing `identity:create_grant(project_id=2eed4fccf56248f98f80122ac4797a38, user_id=7307b307cce44f26adbc3e49b1c36b14, role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:12:59.759747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60a04-cddc-4e28-884e-200ab8d3cd3b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:12:59.841484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 562/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:12:59 2022] PUT /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38/users/7307b307cce44f26adbc3e49b1c36b14/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:13:02.084171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155727-a649-47af-af64-a8bed94c6111 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.084677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155727-a649-47af-af64-a8bed94c6111 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.084791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155727-a649-47af-af64-a8bed94c6111 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.086509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 562/1124] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:02.092271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.092680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.092829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.109063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:02.110269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:02.175396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 563/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:02.199538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155727-a649-47af-af64-a8bed94c6111 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:02.293018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155727-a649-47af-af64-a8bed94c6111 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:02.324705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:02.325550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.325868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.326140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] PATH_INFO: `/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.327580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] RBAC: Authorizing `identity:get_role(role_id=077f810d4cb34a4b8eeaf9f8d5c0d65c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:02.328943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:02.330566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 563/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:02 2022] GET /identity/v3/roles/077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:02.336156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:02.427337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696710e-c980-43fb-bb42-7f97d9c0500f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:02.460199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:02.461026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.461305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.461574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] PATH_INFO: `/v3/users/7307b307cce44f26adbc3e49b1c36b14` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.462755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=7307b307cce44f26adbc3e49b1c36b14)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:02.464155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:02.465767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 564/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:02 2022] GET /identity/v3/users/7307b307cce44f26adbc3e49b1c36b14 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:02.471259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:02.563677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446dfb-d598-4504-a017-7881acb76539 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:02.595258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:02.595878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.596155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.596426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.658125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:02.659563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:02.754174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 564/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:13:02.759993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:02.853544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7b22e-c6e9-4f65-b1e9-e59e45ce3ab3 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:02.885946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:02.886796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:02.887096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:02.887369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] PATH_INFO: `/v3/projects/2eed4fccf56248f98f80122ac4797a38` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:02.888516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] RBAC: Authorizing `identity:get_project(project_id=2eed4fccf56248f98f80122ac4797a38)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:02.889972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f803e0-1a1a-40ad-ad1c-3f1f86fb074b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:02.891641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 565/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:02 2022] GET /identity/v3/projects/2eed4fccf56248f98f80122ac4797a38 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:13:02.897498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:02.991085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3ac8-6d17-49d5-a947-ff7854d11df2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:03.022812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:03.023481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:03.023767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:03.024040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:03.024876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] RBAC: Adding query filter params (role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c, scope.project.id=2eed4fccf56248f98f80122ac4797a38, user.id=7307b307cce44f26adbc3e49b1c36b14) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:03.025182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:03.026692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68862e5a-c665-4404-92e9-33e0f45b3764 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:03.033135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 565/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:13:02 2022] GET /identity/v3/role_assignments?user.id=7307b307cce44f26adbc3e49b1c36b14&scope.project.id=2eed4fccf56248f98f80122ac4797a38&role.id=077f810d4cb34a4b8eeaf9f8d5c0d65c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:05.316821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc8b-ed68-4b18-a13b-6cb004465370 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:05.317320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc8b-ed68-4b18-a13b-6cb004465370 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:05.317320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc8b-ed68-4b18-a13b-6cb004465370 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:05.319047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 566/1131] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:05.324828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:05.325233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:05.325363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:05.341882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:05.343031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:05.404780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 566/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:05.427401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cc8b-ed68-4b18-a13b-6cb004465370 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:05.524014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cc8b-ed68-4b18-a13b-6cb004465370 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:05.555488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:05.556241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:05.556521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:05.556792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:05.558494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:05.559905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf01e-cee2-4e7b-ab15-cdda4c993a3a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:05.561453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 567/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:05.567000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:05.658683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1492d-1a5a-4ca4-903b-476fd8bc2661 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:05.690996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:05.691628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:05.691900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:05.692164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:05.692855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:05.694299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd25181-7a39-4346-8b38-25fb7a89f6f6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:05.802412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 567/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:13:05 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:13:08.112895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62802a5e-7062-4068-b893-5a6667fc6eae None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:08.113496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62802a5e-7062-4068-b893-5a6667fc6eae None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:08.113496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62802a5e-7062-4068-b893-5a6667fc6eae None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:08.115208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 568/1135] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:08.120285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:08.120722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:08.120823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:08.137697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:08.138883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:08.200169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 568/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:08.224718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62802a5e-7062-4068-b893-5a6667fc6eae None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:08.318825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62802a5e-7062-4068-b893-5a6667fc6eae None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:08.350893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:08.351657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:08.351937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:08.352208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:08.353354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:08.354861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850335b1-e6ca-41a1-a099-2b184f2e2fb0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:08.356422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 569/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:08.362197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:08.455088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54467a-5180-4d51-a854-2ea49c1c6178 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:08.486508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:08.487099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:08.487381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:08.487656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:08.488346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:08.489805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2fbc-27ad-4843-a2f3-12f1a79780fd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:08.600949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 569/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:13:08 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:13:10.911214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76955f6-8f30-4f20-9a76-8e9bdd634b9a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:10.911762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76955f6-8f30-4f20-9a76-8e9bdd634b9a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:10.911762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76955f6-8f30-4f20-9a76-8e9bdd634b9a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:10.913484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 570/1139] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:10.918696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:10.919117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:10.919258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:10.935678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:10.936860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:10.999828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 570/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:11.023492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76955f6-8f30-4f20-9a76-8e9bdd634b9a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.119153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76955f6-8f30-4f20-9a76-8e9bdd634b9a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:11.150812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:11.152188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:11.152463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:11.152729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:11.162230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:11.168812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:11.170000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 571/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:11.175823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.269036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889130a-fc64-4521-9b83-d669693d89c4 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:11.299937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:11.300581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:11.300861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:11.301139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:11.301893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:11.302194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:11.303553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:11.311599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 571/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:11.317275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.410650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17faa-831d-4c68-aabe-4514587f302b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:11.441630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:11.442441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:11.442718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:11.442984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] PATH_INFO: `/v3/users/ee193564560047aba2bfa7523f7c53c4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:11.455971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] RBAC: Authorizing `identity:get_user(user_id=ee193564560047aba2bfa7523f7c53c4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:11.457388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:11.458979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 572/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/users/ee193564560047aba2bfa7523f7c53c4 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:11.464441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.556736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4a88f-4d94-4941-98aa-8cb6e9b37ae3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:11.588434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:11.589091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:11.589370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:11.589641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:11.651532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:11.653002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:11.743644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 572/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:13:11.749819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.843426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8b17-e8fd-4a01-91b2-1a7ca2190277 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:11.875521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:11.876358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:11.876638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:11.876906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] PATH_INFO: `/v3/projects/8ec7761a932c4b4f903b0bf988d762ce` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:11.878079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec7761a932c4b4f903b0bf988d762ce)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:11.879499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d587b7-8988-4c1c-99d9-53b7147624b2 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:11.881161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 573/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/projects/8ec7761a932c4b4f903b0bf988d762ce => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:11.887095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:11.979209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb14a-3e1a-44ae-a7a4-b50f67aff244 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:12.010847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:12.011435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:12.011712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:12.011983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:12.012787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=8ec7761a932c4b4f903b0bf988d762ce, user.id=ee193564560047aba2bfa7523f7c53c4) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:12.013093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:12.014555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea3262-bb1c-435d-909b-021b15569022 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:12.019650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 573/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:13:11 2022] GET /identity/v3/role_assignments?user.id=ee193564560047aba2bfa7523f7c53c4&scope.project.id=8ec7761a932c4b4f903b0bf988d762ce&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:14.263262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0c87-e50e-4769-ac0d-2aaee402ec79 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.263777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0c87-e50e-4769-ac0d-2aaee402ec79 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.263777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0c87-e50e-4769-ac0d-2aaee402ec79 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.265487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 574/1147] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:14.270803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.271211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.271347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.288007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:14.289263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:14.351452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 574/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:14.373901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0c87-e50e-4769-ac0d-2aaee402ec79 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:14.468564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0c87-e50e-4769-ac0d-2aaee402ec79 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:14.499934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:14.500691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.500969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.501236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.510921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:14.517628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:14.518737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 575/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:14.524478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:14.616525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f880cbb-6ae2-44b2-9971-21d3a089ab30 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:14.647882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:14.648525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.648804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.649075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.649832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:14.650136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:14.652108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:14.659659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 575/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:14.665163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:14.757905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6465-e3b2-4b6b-85cf-795586d87566 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:14.789407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:14.790216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.790493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.790758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] PATH_INFO: `/v3/users/ee193564560047aba2bfa7523f7c53c4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.791898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] RBAC: Authorizing `identity:get_user(user_id=ee193564560047aba2bfa7523f7c53c4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:14.793303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:14.794877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 576/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:14 2022] GET /identity/v3/users/ee193564560047aba2bfa7523f7c53c4 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:14.800189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:14.894359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f92e5-46e4-46c7-8862-ca73af7f8f54 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:14.925808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:14.926649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:14.926926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:14.927196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] PATH_INFO: `/v3/projects/8ec7761a932c4b4f903b0bf988d762ce` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:14.928356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] RBAC: Authorizing `identity:get_project(project_id=8ec7761a932c4b4f903b0bf988d762ce)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:14.929821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc26b-873e-4961-99c7-054f7e4c5eaa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:14.931486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 576/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:14 2022] GET /identity/v3/projects/8ec7761a932c4b4f903b0bf988d762ce => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:14.938052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:15.032069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d1afb-1243-4f80-bcef-da8ebe411d4a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:15.063527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:15.064340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:15.064621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:15.064904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] PATH_INFO: `/v3/projects/8ec7761a932c4b4f903b0bf988d762ce/users/ee193564560047aba2bfa7523f7c53c4/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:15.066878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec7761a932c4b4f903b0bf988d762ce, user_id=ee193564560047aba2bfa7523f7c53c4, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:15.068315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf82a-c4d4-4e4b-a317-ae0712016d5f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:15.160583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 577/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:13:14 2022] PUT /identity/v3/projects/8ec7761a932c4b4f903b0bf988d762ce/users/ee193564560047aba2bfa7523f7c53c4/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:13:17.405300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d38b-a595-4091-b326-6892fb0c7703 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:17.405850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d38b-a595-4091-b326-6892fb0c7703 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:17.405935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d38b-a595-4091-b326-6892fb0c7703 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:17.407664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 577/1154] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:17.412675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:17.413094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:17.413226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:17.430063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:17.431220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:17.492463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 578/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:17.515170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d38b-a595-4091-b326-6892fb0c7703 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:17.612587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d38b-a595-4091-b326-6892fb0c7703 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:17.643953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:17.644724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:17.645003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:17.645275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:17.655855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:17.662466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:17.663613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 578/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:17.669513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:17.760772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9561-908c-491a-b67e-a3ee8e79817a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:17.792512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:17.793174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:17.793451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:17.793753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:17.794471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:17.794770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:17.796125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:17.803604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 579/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:17.809031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:17.902006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388451d8-e12b-47fc-9da8-57eb2a9a010c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:17.933346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:17.934676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:17.934948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:17.935216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] PATH_INFO: `/v3/users/ee193564560047aba2bfa7523f7c53c4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:17.936369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] RBAC: Authorizing `identity:get_user(user_id=ee193564560047aba2bfa7523f7c53c4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:17.937827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:17.939396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 579/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:17 2022] GET /identity/v3/users/ee193564560047aba2bfa7523f7c53c4 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:17.944908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:18.040178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b9fb-197c-49cc-a5b3-9d735c3b844f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:18.071538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:18.072161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:18.072436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:18.072701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:18.135015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:18.136442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:18.227415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 580/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:13:18.233979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:18.325925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e77e-fe67-47cd-b733-974589e3ce13 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:18.357577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:18.358444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:18.358725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:18.358998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] PATH_INFO: `/v3/projects/8ec7761a932c4b4f903b0bf988d762ce` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:18.360150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] RBAC: Authorizing `identity:get_project(project_id=8ec7761a932c4b4f903b0bf988d762ce)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:18.361585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd5ad-3bf1-4010-889a-6317b131ca9e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:18.363273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 580/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:18 2022] GET /identity/v3/projects/8ec7761a932c4b4f903b0bf988d762ce => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:18.369212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:18.460819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4ff91-8827-4228-83c3-4e830fd314dc None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:18.492309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:18.492880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:18.493158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:18.493427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:18.494370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=8ec7761a932c4b4f903b0bf988d762ce, user.id=ee193564560047aba2bfa7523f7c53c4) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:18.494675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:18.496100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed8ee1-e93c-436a-826c-1213b1990726 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:18.501476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 581/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:13:18 2022] GET /identity/v3/role_assignments?user.id=ee193564560047aba2bfa7523f7c53c4&scope.project.id=8ec7761a932c4b4f903b0bf988d762ce&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:20.780562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2172-036e-4b51-bc2b-5aa766d63ea9 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:20.781087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2172-036e-4b51-bc2b-5aa766d63ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:20.781178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2172-036e-4b51-bc2b-5aa766d63ea9 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:20.782912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 581/1162] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:20.787985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:20.788426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:20.788528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:20.804600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:20.805791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:20.868332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 582/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:20.890081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2172-036e-4b51-bc2b-5aa766d63ea9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:20.986692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2172-036e-4b51-bc2b-5aa766d63ea9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:21.018599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:21.019232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:21.019511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:21.019781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:21.081937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:21.083324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:21.172952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 582/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:13:21.178936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:21.272330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876dc4-0522-4ba5-b3f4-c54ce1cc128d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:21.304236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:21.305014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:21.305296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:21.305564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:21.312592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:21.314090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:21.327799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-ac2b8d52-1e4d-471e-b87e-1ab2aca2b8d7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 25 03:13:21.328938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 583/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:13:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:21.334970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:21.427386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0160e-3a11-40f2-a7ed-6fc0c8c8ad99 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:21.459447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:21.460081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:21.460361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:21.460635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:21.461335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:21.461634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:21.463066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7481a-99fe-44bc-b333-b88b47b2c5f5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:21.469908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 583/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Fri Mar 25 03:13:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:23.716067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a6c5-faa6-4361-955f-5de541aff340 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:23.716591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a6c5-faa6-4361-955f-5de541aff340 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:23.716591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a6c5-faa6-4361-955f-5de541aff340 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:23.718427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 584/1167] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:23.723580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b755f-7dbf-476d-82a7-198da0955aec None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:23.723943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b755f-7dbf-476d-82a7-198da0955aec None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:23.724126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b755f-7dbf-476d-82a7-198da0955aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:23.740355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-a34b755f-7dbf-476d-82a7-198da0955aec None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:23.741520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a34b755f-7dbf-476d-82a7-198da0955aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:23.802980 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 584/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:23.825524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a6c5-faa6-4361-955f-5de541aff340 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:23.921887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a6c5-faa6-4361-955f-5de541aff340 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:23.953092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:23.953741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:23.954020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:23.954293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:23.955020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:23.956657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0ccb-2826-4f08-b203-41235e360e48 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:24.042493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 585/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Fri Mar 25 03:13:23 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:13:26.334633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ac65-ef18-4e8c-8a41-398106e0df18 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:26.335148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ac65-ef18-4e8c-8a41-398106e0df18 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:26.335148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ac65-ef18-4e8c-8a41-398106e0df18 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:26.336895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 585/1170] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:13:26.342548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:26.342918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:26.343103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:26.360014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:26.361181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:26.422879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 586/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:26.445850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ac65-ef18-4e8c-8a41-398106e0df18 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:26.539233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ac65-ef18-4e8c-8a41-398106e0df18 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:26.570394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:26.571215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:26.571485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:26.571748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] PATH_INFO: `/v3/domains/6c4e50cc483a426896674eccfaaab9b0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:26.582397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c4e50cc483a426896674eccfaaab9b0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:26.583835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b54772-745d-41e8-99d4-7a7e1655067b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:26.585463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 586/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Fri Mar 25 03:13:26 2022] GET /identity/v3/domains/6c4e50cc483a426896674eccfaaab9b0 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:26.591607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:26.683110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d45c-ed7e-471d-b657-77e287d2e763 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:26.714823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:26.716030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:26.716307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:26.716576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:26.717254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:26.718700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2bed0-52cb-4691-91bc-eac91df5fcaa None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:26.823962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 587/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:13:26 2022] POST /identity/v3/projects => generated 361 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:13:29.149411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957de81-556e-4f79-ba3c-73f017be192d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:29.149957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957de81-556e-4f79-ba3c-73f017be192d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:29.149957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957de81-556e-4f79-ba3c-73f017be192d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:29.151732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 587/1174] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:29.157438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:29.157847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:29.158025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:29.174949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:29.176122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:29.238616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 588/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:13:29.262791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957de81-556e-4f79-ba3c-73f017be192d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:29.357564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957de81-556e-4f79-ba3c-73f017be192d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:29.388024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:29.388848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:29.389122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:29.389388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] PATH_INFO: `/v3/domains/6c4e50cc483a426896674eccfaaab9b0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:29.390554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c4e50cc483a426896674eccfaaab9b0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:29.391974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295772-e9ec-467a-868f-5c052accba27 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:29.393515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 588/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Fri Mar 25 03:13:29 2022] GET /identity/v3/domains/6c4e50cc483a426896674eccfaaab9b0 => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:29.398975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:29.492325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e01d-56dc-4f0f-9138-731d96ec2185 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:29.523985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:29.524631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:29.524914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:29.525186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:29.525905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:29.527325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fccbea-2567-4443-ac3f-158cf469b5a8 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:29.646474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 589/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:13:29 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:13:31.929905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361484a-6d45-43e5-adac-de1b70626309 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:31.930454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361484a-6d45-43e5-adac-de1b70626309 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:31.930454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361484a-6d45-43e5-adac-de1b70626309 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:31.932212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 589/1178] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:31.937387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:31.937827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:31.937965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:31.954822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:31.956262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:32.019387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 590/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:13:32.042907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361484a-6d45-43e5-adac-de1b70626309 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:32.138747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361484a-6d45-43e5-adac-de1b70626309 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:32.169482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:32.170279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:32.170561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:32.170834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:32.180949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:32.188203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:32.189367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 590/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:32.195346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:32.288010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ae0f9-9af0-4aa4-8112-26c4fb9e927e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:32.320344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:32.320977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:32.321252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:32.321520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:32.322266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:32.322564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:32.323915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:32.332355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 591/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:32.338028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:32.430111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b6dfb-4e4b-482d-a649-f4cc69603052 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:32.463296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:32.464069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:32.464346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:32.464616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] PATH_INFO: `/v3/users/5bc71c48040344a7914a3e0f8554beff` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:32.476816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] RBAC: Authorizing `identity:get_user(user_id=5bc71c48040344a7914a3e0f8554beff)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:32.478292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:32.479889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 591/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/users/5bc71c48040344a7914a3e0f8554beff => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:32.485412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:32.578619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd0412-c277-4741-b800-f41c1430b5e4 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:32.610202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:32.610818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:32.611099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:32.611371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:32.673216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:32.674670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:32.765431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 592/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:13:32.770797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:32.862696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799300b-17d8-4c8e-8e72-4eb7a72828c1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:32.894511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:32.895339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:32.895617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:32.895887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] PATH_INFO: `/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:32.897033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] RBAC: Authorizing `identity:get_project(project_id=c0060250bf1b4d0bac0e685f6a1cc77a)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:32.898486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4064393-6d1a-4d83-91db-dbb798075a96 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:32.900145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 592/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:32.906786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:33.001992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2ddd-a98b-4845-a410-4739279f1bdf None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:33.033745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:33.034349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:33.034632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:33.034908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:33.035710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=c0060250bf1b4d0bac0e685f6a1cc77a, user.id=5bc71c48040344a7914a3e0f8554beff) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:33.036019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:33.037443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ec71-7f6a-4e87-89a0-e38687b50277 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:33.042608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 593/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:13:32 2022] GET /identity/v3/role_assignments?user.id=5bc71c48040344a7914a3e0f8554beff&scope.project.id=c0060250bf1b4d0bac0e685f6a1cc77a&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:35.284620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495f0f-cf16-41c8-b13d-c6aba717c355 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.285128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495f0f-cf16-41c8-b13d-c6aba717c355 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.285128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d495f0f-cf16-41c8-b13d-c6aba717c355 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.286883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 593/1186] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:35.291975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.292382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.292520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.308761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:35.310455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:35.372999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 594/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:35.395663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d495f0f-cf16-41c8-b13d-c6aba717c355 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:35.489427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d495f0f-cf16-41c8-b13d-c6aba717c355 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:35.521371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:35.522163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.522442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.522712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.532223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:35.538993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:35.540074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 594/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:35.546268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:35.638208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f103eb-ab64-459f-ba4a-681ff3ab8605 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:35.670004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:35.670647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.670929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.671201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.671931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:35.672233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:35.673600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:35.681187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 595/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:35.687508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:35.780542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa87a7-53d4-4a82-8c93-b2a640900b16 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:35.812305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:35.813081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.813361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.813633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] PATH_INFO: `/v3/users/5bc71c48040344a7914a3e0f8554beff` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.814818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] RBAC: Authorizing `identity:get_user(user_id=5bc71c48040344a7914a3e0f8554beff)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:35.816247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:35.817842 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 595/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:35 2022] GET /identity/v3/users/5bc71c48040344a7914a3e0f8554beff => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:35.823405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:35.917070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5de-7b09-4913-897b-fa97bd83822d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:35.948330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:35.949160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:35.949438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:35.949759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] PATH_INFO: `/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:35.950903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] RBAC: Authorizing `identity:get_project(project_id=c0060250bf1b4d0bac0e685f6a1cc77a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:35.952321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb528bb-45b9-45e6-b261-479782d43836 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:35.954002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 596/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:35 2022] GET /identity/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:35.960035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:36.053445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f81f-af7a-4dbd-8561-938299f7bc14 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:36.084234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:36.085074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:36.085357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:36.085632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] PATH_INFO: `/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a/users/5bc71c48040344a7914a3e0f8554beff/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:36.087608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0060250bf1b4d0bac0e685f6a1cc77a, user_id=5bc71c48040344a7914a3e0f8554beff, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:36.089048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00aa3-5c77-4641-8c50-8cc735ff4f90 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:36.160524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 596/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:13:35 2022] PUT /identity/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a/users/5bc71c48040344a7914a3e0f8554beff/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:13:38.401780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226a59-d4ea-4ae0-9338-2793aa3f97d4 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:38.402383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226a59-d4ea-4ae0-9338-2793aa3f97d4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:38.402383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226a59-d4ea-4ae0-9338-2793aa3f97d4 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:38.404555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 597/1193] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:13:38.409707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:38.410142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:38.410265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:38.427374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:13:38.428546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:13:38.491028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 597/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:13:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:13:38.514490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc226a59-d4ea-4ae0-9338-2793aa3f97d4 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:38.609121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc226a59-d4ea-4ae0-9338-2793aa3f97d4 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:38.640019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:38.640769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:38.641046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:38.641315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:38.651096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:13:38.658362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:13:38.659440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 598/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:13:38.665121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:38.756814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608115b4-fd19-44d9-a579-a1a3a84d2b4e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:38.788695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:38.789342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:38.789619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:38.789924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:38.790648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:38.790946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:38.792304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:38.799863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 598/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:38.805129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:38.899340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783593-dda1-40e3-aead-55bfd2a7276e None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:38.930239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:38.931026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:38.931300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:38.931565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] PATH_INFO: `/v3/users/5bc71c48040344a7914a3e0f8554beff` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:38.932705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] RBAC: Authorizing `identity:get_user(user_id=5bc71c48040344a7914a3e0f8554beff)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:38.934650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:38.936222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 599/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Fri Mar 25 03:13:38 2022] GET /identity/v3/users/5bc71c48040344a7914a3e0f8554beff => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:38.941818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:39.034798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd70bd-8865-4870-9595-184f30afda58 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:39.066659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:39.067292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:39.067571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:39.067841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:39.130632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:39.132080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:39.223179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 599/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:13:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 25 03:13:39.228956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:39.322422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82616-1dd8-4744-8e82-c5b589b07154 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:39.353415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:39.354271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:39.354549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:39.354818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] PATH_INFO: `/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:39.356492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] RBAC: Authorizing `identity:get_project(project_id=c0060250bf1b4d0bac0e685f6a1cc77a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:39.357932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1abc4-5159-4202-86ed-e664acbe0568 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:39.359561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 600/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Fri Mar 25 03:13:39 2022] GET /identity/v3/projects/c0060250bf1b4d0bac0e685f6a1cc77a => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:13:39.365600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:13:39.457714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc69e-9f35-4336-a1a6-19bc0bb426a9 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:13:39.488936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:13:39.489504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:13:39.489809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:13:39.490081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:13:39.490878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=c0060250bf1b4d0bac0e685f6a1cc77a, user.id=5bc71c48040344a7914a3e0f8554beff) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:13:39.491178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:13:39.492596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96460908-2565-41fa-9a32-9f4dd7ee2d9d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:13:39.498596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 600/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:13:39 2022] GET /identity/v3/role_assignments?user.id=5bc71c48040344a7914a3e0f8554beff&scope.project.id=c0060250bf1b4d0bac0e685f6a1cc77a&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:00.183405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166410-30af-47c6-8f10-7a35a218754f None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:00.183977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166410-30af-47c6-8f10-7a35a218754f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:00.183977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166410-30af-47c6-8f10-7a35a218754f None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:00.185758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 601/1201] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:15:00.191371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:00.191808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:00.191911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:00.208875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:00.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:00.273259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 601/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:00.298139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e166410-30af-47c6-8f10-7a35a218754f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:00.393711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e166410-30af-47c6-8f10-7a35a218754f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:00.425558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:00.426350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:00.426638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:00.426911 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:00.437333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:00.438843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:00.454913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:00.456240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 602/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:00.465876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:00.554467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad2c42-932e-4948-8794-2fef650730ab None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:00.587292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:00.587947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:00.588227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:00.588500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:00.589204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:00.589506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:00.590915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f337a5-1047-4022-9182-d2ed38cceff4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:00.602153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 602/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:00.607668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:00.703648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eebe5e-7444-49cc-a4b5-8c895ed728e1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:00.735983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:00.736568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:00.736842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:00.737108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:00.737824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:00.739235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a398-6829-4aae-b4e6-8b19f62b1886 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:00.867357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 603/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Fri Mar 25 03:15:00 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:15:03.158298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce6a0-f74e-493a-b2a0-8c00c925226b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.158885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce6a0-f74e-493a-b2a0-8c00c925226b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.158885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce6a0-f74e-493a-b2a0-8c00c925226b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.160645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 603/1206] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:03.165835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.169344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.169344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.183225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:03.184392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:03.246771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 604/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:03.270855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fce6a0-f74e-493a-b2a0-8c00c925226b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:03.368068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fce6a0-f74e-493a-b2a0-8c00c925226b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:03.400241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:03.401011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.401294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.401574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.411830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:03.418631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:15:03.419770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 604/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:03.426169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:03.520584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8be8-11d0-428c-aa00-09d3a418eede None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:03.555198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:03.555851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.556131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.556400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.557131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:03.557429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:03.558814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:03.567134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 605/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:03.572826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:03.672010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245091-2fff-4509-9dae-228976fbbf6a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:03.703791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:03.704563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.704836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.705107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.715336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:03.716783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:03.735085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:03.736473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 605/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:03.742144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:03.842163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406e17-cd66-470b-9b2e-babc58d028be None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:03.874428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:03.875070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:03.875350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:03.875616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:03.876353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:03.876650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:03.878032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:03.889537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 606/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:03.895650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:03.990992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448ef41-b2cf-4ffe-afa4-10d00713d002 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.022266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.023049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.023328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.023599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.031250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.032684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.045624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:04.047925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 606/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:04.052867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:04.146963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca889f97-7d77-4af1-8d5b-30d8c97c4b54 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.180172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.180824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.181106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.181377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.182255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:04.182558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.183970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.200403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 607/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:04.206795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:04.300855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04912-dac3-4dcb-aad5-7dc74ee115c3 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.332978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.336591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.336591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.336591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.398750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.400126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.491938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 607/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:15:04.497651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:04.593418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588847f5-e818-4a92-88fb-397e46582697 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.626516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.627309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.627592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.627865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.637530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.639025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.655288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:04.656406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 608/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:04.662196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:04.755460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2550b38-5a60-4964-b685-a70c767cbd48 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.787011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.787720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.788000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.788273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.788987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:04.789285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.790711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.803204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 608/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:04.808899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:04.903531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081fafa-ca15-453b-9af7-e60c6c0da61f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:04.936096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:04.937419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:04.937727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:04.938002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:04.944601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:04.946087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:04.958900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:04.960030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 609/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:04.965796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:05.061426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ea078-5723-45c7-acac-7b062cb2c42c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:05.092411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:05.093535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:05.093918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:05.094186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:05.094941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:05.095246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:05.096670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f105-4a77-4df4-83bb-8c00fd58bffa None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:05.108117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 609/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:05.114726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:05.208850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d950a41-47d9-491b-82b2-5c70c890f3d9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:05.241302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:05.241965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:05.242247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:05.242519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:05.243323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=47e9285da9a24b19afb6038cd95122a5) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:05.243632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:05.245056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14ae20-3a05-4a14-a2b8-68e62cf3f9ad None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:05.250248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 610/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:15:05 2022] GET /identity/v3/role_assignments?user.id=47e9285da9a24b19afb6038cd95122a5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:15:07.529447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36115f-4c48-45d7-858e-4ed0c96ed2ad None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:07.530047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36115f-4c48-45d7-858e-4ed0c96ed2ad None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:07.530047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36115f-4c48-45d7-858e-4ed0c96ed2ad None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:07.531841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 610/1220] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:07.537037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:07.537424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:07.537590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:07.554207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:07.555400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:07.619405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 611/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:07.642380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36115f-4c48-45d7-858e-4ed0c96ed2ad None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:07.739340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36115f-4c48-45d7-858e-4ed0c96ed2ad None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:07.772815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:07.773589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:07.773895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:07.774162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:07.785421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:07.790761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:15:07.791952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 611/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:07.798510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:07.891039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1aeef-9806-4648-b595-47ea2a30e64d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:07.923215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:07.923871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:07.924151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:07.924425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:07.925154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] RBAC: Adding query filter params (name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:07.925453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:07.926867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:07.934353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 612/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:15:07.940687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.034946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314f9b3-d95f-494a-a6d6-8ed98fe6353e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.067321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.068046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.068330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.068606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.079617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.081349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.097767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:08.098935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 612/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:08.104722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.200004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ffff-e6b4-424e-85a0-4a4ebce47916 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.231826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.232458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.232881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.233037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.234354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:08.234649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.235998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.247664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 613/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:08.253273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.347321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d3c4-087c-4609-871f-7c1bd0d4f59b None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.378415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.379180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.379453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.379714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.386745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.390339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.401931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:08.403060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 613/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:08.409452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.504295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439d965-c9a4-4eb0-94ba-f64f744de124 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.537080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.537757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.538042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.538314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.539122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:08.539422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.540829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.557184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 614/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:08.563276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.659499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361326dd-f9a8-4538-9f62-775b226c3e41 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.691649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.692427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.692738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.693006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.703759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.705207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.722520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:08.723680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 614/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:08.729459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.823616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cf158-98bc-4042-a17d-6b4e46f94f7f None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:08.857425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:08.858103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:08.858407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:08.858682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:08.859385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:08.859686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:08.861091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:08.871705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 615/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:08.877819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:08.971878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f8c05-cfa9-4143-bb0a-d43a0d7272b2 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:09.003693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:09.004471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:09.004746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:09.005032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:09.011419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:09.012871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:09.026404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:09.033020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 615/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:09.033411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:09.127736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab4-da55-43bd-bb1c-17cba94c494b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:09.158521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:09.159190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:09.159462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:09.159738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:09.160497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:09.160797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:09.162253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ccce-03d3-49f1-924f-5fb8501f6720 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:09.174542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 616/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:09.180455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:09.275569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0ba86-3a03-40b7-ad83-923ca97e02cb None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:09.307442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:09.308328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:09.308608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:09.308878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/47e9285da9a24b19afb6038cd95122a5/roles/c00c6e8570644c5aa8ff9883ff803f12` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:09.323675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=47e9285da9a24b19afb6038cd95122a5, role_id=c00c6e8570644c5aa8ff9883ff803f12)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:09.325114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ca0c6-6db1-4726-a772-e5d1518ef971 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:09.439076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 616/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:15:09 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/47e9285da9a24b19afb6038cd95122a5/roles/c00c6e8570644c5aa8ff9883ff803f12 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:15:11.711952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f2e4-cfd3-48da-a41f-295b64e711ba None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:11.712527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f2e4-cfd3-48da-a41f-295b64e711ba None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:11.712527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f2e4-cfd3-48da-a41f-295b64e711ba None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:11.714360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 617/1233] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:11.720210 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:11.720665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:11.720793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:11.737326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:11.738535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:11.802774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 617/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:11.825649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f2e4-cfd3-48da-a41f-295b64e711ba None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:11.921926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f2e4-cfd3-48da-a41f-295b64e711ba None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:11.953607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:11.954848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:11.955130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:11.955401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:11.965830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:11.973149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 25 03:15:11.974354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 618/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Fri Mar 25 03:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:11.980337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.075938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eac977-aea9-4ad3-9f1e-e608ddb1cbc6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.108065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.109290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.109568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.109874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.110603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] RBAC: Adding query filter params (name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:12.110903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.112278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:12.120369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 618/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Fri Mar 25 03:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:12.125989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.225757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc393-6665-4a7c-9466-46077145b2a7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.256920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.257684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.257973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.258244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.268711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.270171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:12.286056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:12.287198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 619/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:12.293058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.385596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd025bdc-f816-4b25-85c3-042f1e2e3672 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.417940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.418578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.418858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.419127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.419825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:12.420123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.421550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:12.432198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 619/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:12.437752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.532941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5dac4-b733-4682-9c95-216fee4b3042 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.564708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.565482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.565792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.566065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.573128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.574597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:12.588322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:12.589447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 620/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:12.595113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.689325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42d76-9bcf-4e45-95f1-76e0eebd70f8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.720851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.721500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.721806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.722079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.722885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:12.723182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.724599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:12.741111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 620/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:12.746965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:12.842278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908a78-fd55-40de-adc5-7598ef92a9ef None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:12.874565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:12.875196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:12.875477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:12.875745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:12.938507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:12.939944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.033338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 621/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:15:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:15:13.039103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:13.134183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b991c-9ac2-4045-b282-d573073199c4 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:13.166230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:13.167003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:13.171507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:13.171507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:13.177744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:13.179198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.200654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:13.201948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 621/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:13.207829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:13.302595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2cd26-ee63-435d-9729-9fe8d8dce1b9 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:13.335288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:13.336032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:13.336313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:13.336582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:13.337281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:13.337577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:13.338991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.350257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 622/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:13.355819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:13.449495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1d81-968f-4777-b992-b1239c00b70a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:13.482144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:13.482916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:13.483249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:13.484081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:13.490642 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:13.492079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.504484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:13.505605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 622/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:13.511537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:13.604618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071552-bda7-4d22-86e1-d2ba3df43627 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:13.635913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:13.636546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:13.636821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:13.637089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:13.637869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:13.638241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:13.640140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde88f4c-5e4c-42ec-86c4-0b028b010643 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.651483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 623/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:13.658214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:13.752870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5ed8-36c7-48a4-ab75-1883f3d99da5 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:13.785386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:13.786124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:13.786406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:13.786673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:13.787467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] RBAC: Adding query filter params (role.id=c00c6e8570644c5aa8ff9883ff803f12, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=47e9285da9a24b19afb6038cd95122a5) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:13.787766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:13.789189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367ba7-f916-4a9f-8d4c-d72e02cc8fdf None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:13.799995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 623/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:15:13 2022] GET /identity/v3/role_assignments?user.id=47e9285da9a24b19afb6038cd95122a5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=c00c6e8570644c5aa8ff9883ff803f12 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:16.093824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1114a-b33d-4bd4-9620-4c1703228dd1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.094353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1114a-b33d-4bd4-9620-4c1703228dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.094353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1114a-b33d-4bd4-9620-4c1703228dd1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.096090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 624/1247] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:16.101289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.101769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.101870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.118852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:16.120172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:16.183479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 624/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:16.208011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1114a-b33d-4bd4-9620-4c1703228dd1 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:16.304439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1114a-b33d-4bd4-9620-4c1703228dd1 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:16.337617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:16.339432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.339432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.339432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.348920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:16.355667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:15:16.356856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 625/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:16.362860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:16.456934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72edb5d-8921-4ff1-ba76-d48300ab0070 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:16.488170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:16.488813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.489090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.489360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.490109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:16.490406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:16.491796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:16.500014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 625/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:16.505799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:16.600252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb93d-728d-47f0-b742-d61327f833af None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:16.633166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:16.633970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.634256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.634531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.644775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:16.646580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:16.662114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:16.663260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 626/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:16.668947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:16.764515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41dfe2-025a-4c45-b749-09d6050c8290 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:16.795470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:16.796614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.796933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.797207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.797955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:16.798253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:16.799638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:16.811182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 626/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:16.817332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:16.912783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85cf4-4fd2-4d90-a07b-89ec777058aa None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:16.945628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:16.946466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:16.946752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:16.947027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:16.954233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:16.955972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:16.969984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:16.971157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 627/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:16.977002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.072306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53b27-69bd-4f93-8807-56db3f019a20 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:17.104822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:17.105483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:17.105791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:17.106066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:17.106899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:17.107205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:17.109241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:17.125485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 627/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:17.131293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.228788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9655-ef25-4ac4-a9e5-a52b216fd18a None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:17.261092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:17.261748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:17.262031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:17.262326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:17.324525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:17.325983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:17.418734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 628/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:15:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:15:17.424505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.518184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7196f-5180-45e4-a9ba-cc1ffc2f104f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:17.553570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:17.554377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:17.554657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:17.554931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:17.566233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:17.568375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:17.586104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:17.587258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 628/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:17.593623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.686742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e725af3-083c-40a0-92aa-1fb878b92d78 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:17.720221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:17.720863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:17.721139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:17.721407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:17.722134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:17.722433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:17.723778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:17.734377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 629/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:17.739838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.836756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede0d7-90f2-4730-930e-858245982312 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:17.868612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:17.869392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:17.869696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:17.869972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:17.876962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:17.878514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:17.891764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:17.892918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 629/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:17.898774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:17.995447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c478-ea5d-4a55-b617-5c0c3c731c0d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:18.027846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:18.028505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:18.028781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:18.029049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:18.029838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:18.030143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:18.031573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c24ae-e04b-46e0-8453-fc55f8d279d0 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:18.042924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 630/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:18.048957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:18.145222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d691d-72d3-40bf-be91-ec82229939d7 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:18.176876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:18.177857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:18.178314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:18.178771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:18.180159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=47e9285da9a24b19afb6038cd95122a5) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:18.180664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:18.183057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176dffa-a005-4715-ab75-b878393418fd None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:18.189002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 630/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:15:18 2022] GET /identity/v3/role_assignments?user.id=47e9285da9a24b19afb6038cd95122a5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:20.421364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333a64-5b0a-49a5-b20b-01293166d1f9 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:20.422027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333a64-5b0a-49a5-b20b-01293166d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:20.422027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333a64-5b0a-49a5-b20b-01293166d1f9 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:20.423674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 631/1261] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:20.428939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:20.429334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:20.429489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:20.446030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:20.447200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:20.511281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 631/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:20.534306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a333a64-5b0a-49a5-b20b-01293166d1f9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:20.630901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a333a64-5b0a-49a5-b20b-01293166d1f9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:20.663839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:20.664599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:20.664874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:20.665139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:20.674727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:20.681261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:15:20.682434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 632/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:15:20.688453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:20.784376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cf67d-8c88-448e-9b16-c94c0266a8c6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:20.816940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:20.817590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:20.817899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:20.818170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:20.818892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:20.819189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:20.820554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:20.829026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 632/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:20.835089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:20.930714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6011f-2feb-4fec-b0ab-4a59352820fe None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:20.963014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:20.963792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:20.964071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:20.964389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:20.974450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:20.975889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:20.991363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:20.992500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 633/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:20.998336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.094080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61787fdf-afe2-486a-9774-c4bc05c71228 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.126121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.126762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.127041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.127315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.128020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:21.128320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.129830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.141110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 633/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:21.146713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.241795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388bc3a-8890-46ea-803a-55559105d935 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.274323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.275105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.275381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.275649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.282740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.284159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.297408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:21.302765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 634/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:21.304506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.400903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a694b65-2162-4949-be2a-442d730b21c8 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.432707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.433358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.433636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.433941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.434775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:21.435081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.437091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.453142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 634/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:21.458951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.553360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1052-ca0f-4d17-990c-f673fc8e373b None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.584329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.585096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.585377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.585648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.596090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.597535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.613645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:21.614811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 635/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:15:21.620395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.713539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9b60-32f9-471f-a0de-4f007176cf7f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.746868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.747522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.747794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.748067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.748766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:21.749064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.750469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.761160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 635/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:21.766626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:21.861850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff15d-b912-44ea-bbbb-1d4624903241 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:21.895244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:21.896010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:21.896286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:21.896557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:21.902854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:21.904296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:21.917735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:21.918863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 636/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:21.924763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:22.019776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712138-29aa-42f7-9abb-e206b9a9a81e None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:22.051383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:22.052027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:22.052309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:22.052582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:22.053349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:22.053759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:22.055111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7665d-4827-41f5-85e0-017a19494053 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:22.067375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 636/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:22.073419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:22.169240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14eef7-1ee2-4e02-9d41-c08a3238d7bb None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:22.200918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:22.202325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:22.202613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:22.202877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] PATH_INFO: `/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/47e9285da9a24b19afb6038cd95122a5/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:22.204769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3df45ec7150f4e2990b00240f7fce2a2, user_id=47e9285da9a24b19afb6038cd95122a5, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:22.206496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863cd9a-8e7f-410f-9cf9-0921fcff2be1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:22.289605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 637/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Fri Mar 25 03:15:22 2022] PUT /identity/v3/projects/3df45ec7150f4e2990b00240f7fce2a2/users/47e9285da9a24b19afb6038cd95122a5/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:15:24.544145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a82a9-8a03-465f-a698-a183cf6169f5 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:24.544672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a82a9-8a03-465f-a698-a183cf6169f5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:24.544672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a82a9-8a03-465f-a698-a183cf6169f5 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:24.547235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 637/1274] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:24.552539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:24.552915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:24.553078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:24.569841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:24.571048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:24.634852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 638/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:24.658776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a82a9-8a03-465f-a698-a183cf6169f5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:24.754474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a82a9-8a03-465f-a698-a183cf6169f5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:24.786096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:24.786860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:24.787136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:24.787403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:24.797590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 25 03:15:24.804211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 25 03:15:24.805350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 638/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Fri Mar 25 03:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 25 03:15:24.811229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:24.905631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6120-9995-4d63-b84b-ef4087bd3d98 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:24.937486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:24.938165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:24.938450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:24.938719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:24.939445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:24.939746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:24.941102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:24.948746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 639/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Fri Mar 25 03:15:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:24.955087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.052482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0286f6-d080-420d-a88b-c0e0e42c4f01 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:25.084460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:25.086667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:25.086667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:25.086667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:25.096359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:25.097831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:25.113354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:25.114512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 639/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:25.120267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.215639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dcfb-7ce5-4f26-873b-2f68918df90d None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:25.247036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:25.247671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:25.247946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:25.248269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:25.249472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:25.249798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:25.251141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:25.262175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 640/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:25.268385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.361677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28750d-d777-4a09-bad4-5efa647b274a None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:25.393866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:25.394646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:25.394927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:25.395198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:25.402442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:25.403884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:25.416920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 25 03:15:25.418073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 640/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:25.423794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.521838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b250-a147-478a-999c-6b7e5b3bf951 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:25.553837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:25.554489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:25.554769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:25.555042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:25.555897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:25.556200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:25.557626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:25.575104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 641/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Fri Mar 25 03:15:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:25.581730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.675921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5d63-6db2-41fa-8a3e-22f1c16e4a2f None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:25.707706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:25.708349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:25.708604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:25.708872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:25.771869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:25.773309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:25.866423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 641/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Fri Mar 25 03:15:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 25 03:15:25.872244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:25.970162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3220-4f01-4590-b3b1-36843a6b8ca7 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:26.122954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:26.123717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:26.123992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:26.124274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:26.133748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:26.135205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:26.151023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 25 03:15:26.152184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 642/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:26.158543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:26.252850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c467e-2002-4325-926b-39ca4bf0f381 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:26.284969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:26.285613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:26.285925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:26.286198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:26.286896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:26.287195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:26.288568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:26.299901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 642/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Fri Mar 25 03:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:26.305460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:26.398924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301901-3427-413a-a001-9feb46a1ff0c None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:26.430679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:26.431438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:26.431716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:26.431986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:26.438330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:26.439779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:26.452765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING keystone.server.flask.application [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 25 03:15:26.453910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 643/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Fri Mar 25 03:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:26.462917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:26.557652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657940e-8b07-4687-b9e7-acb34d5dae17 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:26.589276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:26.589951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:26.590230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:26.590501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:26.591271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:26.591572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:26.593619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998bf-ea6b-4463-a8aa-eed37377e8d7 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:26.604998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 643/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Fri Mar 25 03:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:26.611180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:26.706463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b908b-0596-442e-9376-41b559925f25 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:26.738210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:26.738866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:26.739143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:26.739412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:26.740206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] RBAC: Adding query filter params (role.id=36a26de00c7141a09176dacfb7236db0, scope.project.id=3df45ec7150f4e2990b00240f7fce2a2, user.id=47e9285da9a24b19afb6038cd95122a5) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:26.740509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:26.741948 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6b0d2-0bbc-4480-be03-bbc3ed60d1e6 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:26.747365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 644/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Fri Mar 25 03:15:26 2022] GET /identity/v3/role_assignments?user.id=47e9285da9a24b19afb6038cd95122a5&scope.project.id=3df45ec7150f4e2990b00240f7fce2a2&role.id=36a26de00c7141a09176dacfb7236db0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:29.038686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0db26-97fb-4e0f-b413-8f585c072221 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:29.039200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0db26-97fb-4e0f-b413-8f585c072221 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:29.039305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0db26-97fb-4e0f-b413-8f585c072221 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:29.040994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 644/1288] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:29.046912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:29.053775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:29.053775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:29.063896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:29.065074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:29.128807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 645/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 25 03:15:29.151040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0db26-97fb-4e0f-b413-8f585c072221 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:29.248261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0db26-97fb-4e0f-b413-8f585c072221 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:29.280482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:29.281262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:29.281542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:29.281845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] PATH_INFO: `/v3/services/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:29.282483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:29.283878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:29.294536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 25 03:15:29.296342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 645/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:15:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:29.302294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:29.397246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f2460-66c9-457e-ac48-31a741da71f8 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:29.429932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:29.430570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:29.430852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:29.448677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:29.448677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:29.448677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:29.448677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736a62-623a-4c7a-9da6-1472e2a7b206 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:29.448677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 646/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Fri Mar 25 03:15:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:29.449111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:29.540142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7d67-d8f5-41b6-955c-2314353e831c None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:29.571251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:29.571895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:29.572172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:29.572441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] PATH_INFO: `/v3/services` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:29.573122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:29.573417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:29.574855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634003a-89bb-470b-a285-a3c8a46b82b2 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:29.579614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 646/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Fri Mar 25 03:15:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:31.823619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fa49-7ee9-4a9f-ba4e-7c79ca4cb68a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:31.824148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fa49-7ee9-4a9f-ba4e-7c79ca4cb68a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:31.824148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fa49-7ee9-4a9f-ba4e-7c79ca4cb68a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:31.825954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 647/1293] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:31.831000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8937-9eee-4ca8-9eee-1e61bc82b25e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:31.831628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8937-9eee-4ca8-9eee-1e61bc82b25e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:31.831820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8937-9eee-4ca8-9eee-1e61bc82b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:31.848489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-09df8937-9eee-4ca8-9eee-1e61bc82b25e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:31.849754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-09df8937-9eee-4ca8-9eee-1e61bc82b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:31.913619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 647/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:31.937127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055fa49-7ee9-4a9f-ba4e-7c79ca4cb68a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:32.034447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055fa49-7ee9-4a9f-ba4e-7c79ca4cb68a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:32.066142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:32.066784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:32.067063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:32.067332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:32.068031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:32.069382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e66c69-62a1-4f78-b274-429d436b6991 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:32.159102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 648/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Fri Mar 25 03:15:31 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:15:34.479469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a320-be90-45ef-bd82-dc3418f28ec2 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:34.479994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a320-be90-45ef-bd82-dc3418f28ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:34.479994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a320-be90-45ef-bd82-dc3418f28ec2 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:34.481817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 648/1296] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:34.487567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:34.487981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:34.488111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:34.504198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:34.505362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:34.573284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 649/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:34.596432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a320-be90-45ef-bd82-dc3418f28ec2 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:34.691406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a320-be90-45ef-bd82-dc3418f28ec2 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:34.724069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:34.724848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:34.725127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:34.725398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:34.726060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:34.727429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:34.740410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 25 03:15:34.740410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 649/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:15:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:34.745372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:34.839603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10a88a-3fd4-47cf-ba98-c53708c98ea3 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:34.871274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:34.877845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:34.879708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 650/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Fri Mar 25 03:15:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:34.885737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:34.982317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8da8c-48cb-460e-8a97-d7361cc0a0a1 None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:35.015644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:35.016226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:35.016504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:35.016774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:35.017542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] RBAC: Adding query filter params (interface=public, service_id=70235c4b49214185a9ccac686990688f, region_id=RegionOne) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:35.017876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:35.019249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abdbf2-441f-4500-8add-9179ee767ede None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:35.024111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 650/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Fri Mar 25 03:15:34 2022] GET /identity/v3/endpoints?service_id=70235c4b49214185a9ccac686990688f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:15:35.029886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:35.124465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0ad6-c837-4d2b-97c0-f6b8fb0f3fc1 None admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:35.157445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869929-2515-4d24-a063-7c051050048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:35.158174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869929-2515-4d24-a063-7c051050048b None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:35.158456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869929-2515-4d24-a063-7c051050048b None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:35.158725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869929-2515-4d24-a063-7c051050048b None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:35.159383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7869929-2515-4d24-a063-7c051050048b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:35.160732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7869929-2515-4d24-a063-7c051050048b None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:35.167337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 651/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Fri Mar 25 03:15:35 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:15:37.444811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1bb-418e-4ffe-9923-e6f956b5935d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:37.445369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1bb-418e-4ffe-9923-e6f956b5935d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:37.445369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1bb-418e-4ffe-9923-e6f956b5935d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:37.447089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 651/1302] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:15:37.453022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:37.453433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:37.457338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:37.470354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:15:37.471509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:15:37.540920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 652/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:15:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 25 03:15:37.564567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a1bb-418e-4ffe-9923-e6f956b5935d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:37.661169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a1bb-418e-4ffe-9923-e6f956b5935d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:37.693236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:37.694038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:37.694316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:37.694585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:37.695254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:37.696666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:37.707731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING keystone.server.flask.application [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 25 03:15:37.708854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 652/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Fri Mar 25 03:15:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 25 03:15:37.714841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:37.806556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40f37-28b8-4c67-b11d-d31a96090cf2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:37.838788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:37.839431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:37.839711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:37.839980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] PATH_INFO: `/v3/services` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:37.840663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] RBAC: Adding query filter params (name=placement) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:15:37.840970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:37.842352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8bf7-c269-4116-93f1-f5e6f528630d None admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:37.847184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 653/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Fri Mar 25 03:15:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:15:37.852922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:15:37.948489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753692-4eea-4b63-8f18-39fbda67f99d None admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:15:37.980771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:15:37.981429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:15:37.981738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:15:37.982013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:15:37.983413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:15:37.984800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063d42-f9fc-4079-ad3d-39b4e26c4ff6 None admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:15:38.119229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 653/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Fri Mar 25 03:15:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:22:45.747938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8a7-dae5-40a0-a220-e59622782c79 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:45.748396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8a7-dae5-40a0-a220-e59622782c79 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:45.748969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e8a7-dae5-40a0-a220-e59622782c79 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:45.756827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c405b1-bb6c-4a54-88eb-1dcbef42d2db None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:45.757218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c405b1-bb6c-4a54-88eb-1dcbef42d2db None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:45.757498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c405b1-bb6c-4a54-88eb-1dcbef42d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:45.761510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 654/1307] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:22:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:22:45.829201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b4c405b1-bb6c-4a54-88eb-1dcbef42d2db None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:45.830459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b4c405b1-bb6c-4a54-88eb-1dcbef42d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:45.958145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 654/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:22:46.004239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:46.004587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:46.004849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:46.013161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 655/1309] 10.222.0.24 () {54 vars in 963 bytes} [Fri Mar 25 03:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:22:46.015808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dff3f-bb65-4138-a576-dba03db619d8 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:46.016341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dff3f-bb65-4138-a576-dba03db619d8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:46.016757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dff3f-bb65-4138-a576-dba03db619d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:46.113826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-285dff3f-bb65-4138-a576-dba03db619d8 None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:46.115137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-285dff3f-bb65-4138-a576-dba03db619d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:46.192209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 655/1310] 10.222.0.24 () {58 vars in 1060 bytes} [Fri Mar 25 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:22:46.202386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:22:46.204123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:46.316865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903874-cce3-4083-988e-4f5cad6a590d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:22:46.391110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:22:46.391755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:46.392043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:46.392315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:46.393970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:46.502291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:22:46.503888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3784eb-266b-4bdd-80ab-0aed2fab4b83 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:22:46.523180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 656/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:22:49.086580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:49.087056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:49.087133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:49.089981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 656/1312] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:22:49.094439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db3c8-c68e-493a-931d-321e3725dc82 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:49.094860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db3c8-c68e-493a-931d-321e3725dc82 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:49.094984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db3c8-c68e-493a-931d-321e3725dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:49.196357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-480db3c8-c68e-493a-931d-321e3725dc82 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:49.198167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-480db3c8-c68e-493a-931d-321e3725dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:49.310173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 657/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:22:49.348430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:22:49.350073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:49.452558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f42258-27ba-4f35-bc51-c466cead7705 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:22:49.524581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:22:49.525464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:49.525773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:49.526047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:49.527742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:49.636052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:22:49.637520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3531f-fa2e-493c-853e-8a331b9c735f service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:22:49.655968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 657/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:22:52.593487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b35c-9203-4d06-be79-0f6fc9556e28 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:52.594109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b35c-9203-4d06-be79-0f6fc9556e28 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:52.594109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b35c-9203-4d06-be79-0f6fc9556e28 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:52.595800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 658/1315] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:22:52.600835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526b3e-31ff-4693-bb41-acd3c4075f3a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:52.601244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526b3e-31ff-4693-bb41-acd3c4075f3a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:52.601378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526b3e-31ff-4693-bb41-acd3c4075f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:52.665385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c9526b3e-31ff-4693-bb41-acd3c4075f3a None None] MFA Rules not processed for user `961c71cb778245dc92e8ea1976208eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:52.666609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c9526b3e-31ff-4693-bb41-acd3c4075f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:52.758681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 658/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:22:52.814894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545497f-b888-4727-a259-2e11235b8227 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:52.815175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545497f-b888-4727-a259-2e11235b8227 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:52.815445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545497f-b888-4727-a259-2e11235b8227 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:52.817186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 659/1317] 10.222.0.24 () {54 vars in 963 bytes} [Fri Mar 25 03:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:22:52.823242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc84-592d-487a-bdc6-259f0ed0f166 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:52.823536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc84-592d-487a-bdc6-259f0ed0f166 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:52.823817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc84-592d-487a-bdc6-259f0ed0f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:52.895613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0e2bdc84-592d-487a-bdc6-259f0ed0f166 None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:52.896734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0e2bdc84-592d-487a-bdc6-259f0ed0f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:52.968365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 659/1318] 10.222.0.24 () {58 vars in 1060 bytes} [Fri Mar 25 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:22:52.977189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545497f-b888-4727-a259-2e11235b8227 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:22:52.979212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f545497f-b888-4727-a259-2e11235b8227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:53.077866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545497f-b888-4727-a259-2e11235b8227 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:22:53.146971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:22:53.147534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:53.147814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:53.148088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:53.150233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:53.252565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:22:53.254030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379468da-13ba-4cf5-826e-3f0672ccfcd4 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:22:53.271144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 660/1319] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:22:56.726918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:56.727504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:56.727504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:56.729289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 660/1320] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:22:56.734557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca037cb-9355-4f42-87a3-75f1d69348ee None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:56.734937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca037cb-9355-4f42-87a3-75f1d69348ee None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:56.735109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca037cb-9355-4f42-87a3-75f1d69348ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:56.796952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-fca037cb-9355-4f42-87a3-75f1d69348ee None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:22:56.798169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fca037cb-9355-4f42-87a3-75f1d69348ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:56.890758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 661/1321] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:22:56.929106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:22:56.931177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:57.030957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7fd8f-121b-4c47-9c1a-80b1c6e337a3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:22:57.101273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:22:57.101941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:22:57.102226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:22:57.102502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:22:57.104120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:22:57.209219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:22:57.210948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f8afe-d0c5-491a-afb5-699d321a1754 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:22:57.228442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 661/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:22:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:00.557467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:00.558086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:00.558086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:00.559821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 662/1323] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:00.564941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3fa-3265-495f-9b1c-e7ac7d343150 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:00.565384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3fa-3265-495f-9b1c-e7ac7d343150 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:00.565480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3fa-3265-495f-9b1c-e7ac7d343150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:00.628007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-eea3a3fa-3265-495f-9b1c-e7ac7d343150 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:00.629183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-eea3a3fa-3265-495f-9b1c-e7ac7d343150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:00.721298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 662/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:00.757397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:00.759023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:00.862156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045702c-5007-4fc2-b305-1efcc6b18561 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:00.938291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:00.938939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:00.939217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:00.939486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:00.941093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:01.047125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:01.048560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bd83c-7b5c-4621-8054-e548eee0561a service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:01.066299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 663/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:03.416616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:03.417352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:03.417352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:03.418906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 663/1326] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:03.424091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf251-e471-4c66-9d7d-841336552d6d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:03.424512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf251-e471-4c66-9d7d-841336552d6d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:03.424657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf251-e471-4c66-9d7d-841336552d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:03.487758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5b2cf251-e471-4c66-9d7d-841336552d6d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:03.488954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b2cf251-e471-4c66-9d7d-841336552d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:03.583127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 664/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:03.619470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:03.621012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:03.721914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc8cb-e199-4e7f-9ebd-41639b01faa7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:03.792033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:03.792672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:03.792959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:03.793232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:03.794890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:03.898881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:03.900359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bd263-6afc-4d2a-abd9-fc4649bbfea9 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:03.917874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 664/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:06.282484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:06.283017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:06.283017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:06.284836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 665/1329] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:06.290679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57960f0-f7e7-494f-9b9d-b7295d79e01a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:06.291089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57960f0-f7e7-494f-9b9d-b7295d79e01a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:06.291222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57960f0-f7e7-494f-9b9d-b7295d79e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:06.354847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d57960f0-f7e7-494f-9b9d-b7295d79e01a None None] MFA Rules not processed for user `961c71cb778245dc92e8ea1976208eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:06.356032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d57960f0-f7e7-494f-9b9d-b7295d79e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:06.450446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 665/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:06.488920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:06.490475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:06.590945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6b8dd-3419-47b0-b9fd-fec8e57e7468 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:06.662885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:06.663520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:06.663796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:06.664062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:06.665684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:06.768306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:06.769757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262263a5-0832-4939-8888-e85acad1d290 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:06.787350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 666/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:09.534438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:09.535019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:09.535019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:09.536797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 666/1332] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:09.541996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022872-9fee-485b-90fb-13a5bdce3e8a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:09.542441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022872-9fee-485b-90fb-13a5bdce3e8a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:09.542441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022872-9fee-485b-90fb-13a5bdce3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:09.607323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e1022872-9fee-485b-90fb-13a5bdce3e8a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:09.608533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e1022872-9fee-485b-90fb-13a5bdce3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:09.706141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 667/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:09.742295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:09.743869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:09.849127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9465897-6a4e-4ca2-bf7d-7323d7c566db None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:09.928001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:09.928727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:09.929011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:09.929285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:09.930997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:10.043520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:10.046977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1169d-e562-4cb1-8672-4f3745b12ab3 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:10.064809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 667/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:12.424942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:12.425503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:12.425503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:12.427302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 668/1335] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:12.432410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b421-bf67-4900-9e2e-9bee296eedee None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:12.432817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b421-bf67-4900-9e2e-9bee296eedee None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:12.432958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b421-bf67-4900-9e2e-9bee296eedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:12.495548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0e24b421-bf67-4900-9e2e-9bee296eedee None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:12.496733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0e24b421-bf67-4900-9e2e-9bee296eedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:12.590516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 668/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:23:12.629308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:12.630886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:12.734904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd600127-e370-4b63-85f4-6d7bb5eb0aee None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:12.800495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:12.801123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:12.801400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:12.801694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:12.803304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:12.909228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:12.910709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba8f9d-fb19-4eb4-bd46-dffab9820213 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:12.927707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 669/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:15.843579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:15.844023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:15.844119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:15.845984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 669/1338] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:15.851197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c094a-260a-42b8-9671-152a3f1ffab9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:15.851615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c094a-260a-42b8-9671-152a3f1ffab9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:15.851762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c094a-260a-42b8-9671-152a3f1ffab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:15.913261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c37c094a-260a-42b8-9671-152a3f1ffab9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:15.914488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c37c094a-260a-42b8-9671-152a3f1ffab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:16.007535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 670/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:16.043881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:16.047261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:16.156556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32cbb-ea9d-4ee5-9637-c7b23f17a02d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:16.160204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:16.160819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:16.162988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:16.162988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:16.163184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:16.267288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:16.268775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b08b48-33f5-4ede-bdaf-4297a9bae28e service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:16.286898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 670/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:20.915251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:20.915778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:20.915778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:20.917558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 671/1341] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:20.922760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2c7c-16a3-421e-bdf3-3add81045023 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:20.923147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2c7c-16a3-421e-bdf3-3add81045023 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:20.923308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2c7c-16a3-421e-bdf3-3add81045023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:20.969442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bb3a2c7c-16a3-421e-bdf3-3add81045023 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:20.970675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bb3a2c7c-16a3-421e-bdf3-3add81045023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:21.045312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 671/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:23:21.084177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:21.086532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:21.099483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c270-c1ec-48a9-b3f1-b5736dfb7994 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:21.102921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:21.103534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:21.103809 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:21.104076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:21.112476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:21.113949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd798bb-41b1-4ccd-93ea-ce8b75127954 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:21.123473 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 672/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:24.565734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b1ec-93d0-4c17-b355-a79fe14141fc None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:24.566331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b1ec-93d0-4c17-b355-a79fe14141fc None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:24.566331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b1ec-93d0-4c17-b355-a79fe14141fc None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:24.568213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 672/1344] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:24.573373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de2d0c-b693-49ac-a362-9ff6c0b80159 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:24.573835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de2d0c-b693-49ac-a362-9ff6c0b80159 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:24.573989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de2d0c-b693-49ac-a362-9ff6c0b80159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:24.601021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d9de2d0c-b693-49ac-a362-9ff6c0b80159 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:24.602768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d9de2d0c-b693-49ac-a362-9ff6c0b80159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:24.610471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 673/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:24.647794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b1ec-93d0-4c17-b355-a79fe14141fc None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:24.659064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b1ec-93d0-4c17-b355-a79fe14141fc None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:24.662647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:24.663287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:24.663567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:24.664417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:24.673416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:24.674901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04753426-b623-4a4b-9f53-affa56869f43 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:24.684240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 673/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:29.506192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812586f9-f2e3-4413-b6ba-3160bb956bc4 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:29.506751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812586f9-f2e3-4413-b6ba-3160bb956bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:29.506751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812586f9-f2e3-4413-b6ba-3160bb956bc4 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:29.509105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 674/1347] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:29.514409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b05f-cd74-45ab-81dc-a4cf1d0c70fd None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:29.514872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b05f-cd74-45ab-81dc-a4cf1d0c70fd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:29.514969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b05f-cd74-45ab-81dc-a4cf1d0c70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:29.532376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5e52b05f-cd74-45ab-81dc-a4cf1d0c70fd None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:29.533492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5e52b05f-cd74-45ab-81dc-a4cf1d0c70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:29.541750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 674/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:29.579402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812586f9-f2e3-4413-b6ba-3160bb956bc4 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:29.589973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812586f9-f2e3-4413-b6ba-3160bb956bc4 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:29.593411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:29.594070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:29.594350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:29.594624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:29.603961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:29.605394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978b53b-ade7-41f2-9543-707e360a18bd service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:29.614602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 675/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:34.894840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9246eb-e9dd-493f-9f58-3c7ae05dfbfb None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:34.895785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9246eb-e9dd-493f-9f58-3c7ae05dfbfb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:34.896217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9246eb-e9dd-493f-9f58-3c7ae05dfbfb None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:34.898683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 675/1350] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:23:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:34.903677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4149c-20fd-4ecd-b32e-83876c6645a1 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:34.904092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4149c-20fd-4ecd-b32e-83876c6645a1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:34.904199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4149c-20fd-4ecd-b32e-83876c6645a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:34.986112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2fd4149c-20fd-4ecd-b32e-83876c6645a1 None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:34.987497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2fd4149c-20fd-4ecd-b32e-83876c6645a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:35.063361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 676/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:39.351672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50660bf-2574-4df7-814c-0b4726a75f71 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:39.352583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50660bf-2574-4df7-814c-0b4726a75f71 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:39.353006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50660bf-2574-4df7-814c-0b4726a75f71 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:39.354875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 676/1352] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:39.360551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547578-0513-4625-97db-a5e0577af28f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:39.360997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547578-0513-4625-97db-a5e0577af28f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:39.361088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547578-0513-4625-97db-a5e0577af28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:39.381026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ed547578-0513-4625-97db-a5e0577af28f None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:39.382745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ed547578-0513-4625-97db-a5e0577af28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:39.391729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 677/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:40.978350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b421e-6e83-41a0-aae9-5cc39e9266aa None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:40.978903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b421e-6e83-41a0-aae9-5cc39e9266aa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:40.978903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b421e-6e83-41a0-aae9-5cc39e9266aa None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:40.980676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 677/1354] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:40.986136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23b3cd-7686-46b6-a00f-b874b252b341 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:40.986615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23b3cd-7686-46b6-a00f-b874b252b341 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:40.986880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23b3cd-7686-46b6-a00f-b874b252b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:41.004624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cc23b3cd-7686-46b6-a00f-b874b252b341 None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:41.005828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cc23b3cd-7686-46b6-a00f-b874b252b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:41.014640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 678/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:23:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:23:44.811617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c20b-774e-4840-b45e-a6668f179435 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:44.812157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c20b-774e-4840-b45e-a6668f179435 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:44.812157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c20b-774e-4840-b45e-a6668f179435 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:44.813947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 678/1356] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:44.819648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a748-d210-40e3-a9e2-505c0f7e5259 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:44.820398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a748-d210-40e3-a9e2-505c0f7e5259 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:44.820676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a748-d210-40e3-a9e2-505c0f7e5259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:44.840729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5ee9a748-d210-40e3-a9e2-505c0f7e5259 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:44.841916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5ee9a748-d210-40e3-a9e2-505c0f7e5259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:44.849837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 679/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:23:44.896423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7d2b-bb1a-4da8-8279-df6bc20cbb48 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:44.896710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7d2b-bb1a-4da8-8279-df6bc20cbb48 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:44.896980 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7d2b-bb1a-4da8-8279-df6bc20cbb48 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:44.899752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 679/1358] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:44.904631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f54d4-16df-48be-8d22-82f6d0bfefe1 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:44.904915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f54d4-16df-48be-8d22-82f6d0bfefe1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:44.905184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f54d4-16df-48be-8d22-82f6d0bfefe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:44.964565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d02f54d4-16df-48be-8d22-82f6d0bfefe1 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:44.966112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d02f54d4-16df-48be-8d22-82f6d0bfefe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:45.055436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 680/1359] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:23:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:45.063483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb7d2b-bb1a-4da8-8279-df6bc20cbb48 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:45.092540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb7d2b-bb1a-4da8-8279-df6bc20cbb48 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:45.098946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:45.099596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:45.099896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:45.100400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:45.110388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:45.111976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471bf3-be43-47c8-8bfc-62e3e2749d21 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:45.122833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 680/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:47.632145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef789-b5a0-4db7-a574-abc261750ea7 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:47.632684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef789-b5a0-4db7-a574-abc261750ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:47.632684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef789-b5a0-4db7-a574-abc261750ea7 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:47.634703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 681/1361] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:47.639921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff52d-1e48-4619-9b72-668628323337 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:47.640393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff52d-1e48-4619-9b72-668628323337 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:47.640651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ff52d-1e48-4619-9b72-668628323337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:47.658729 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c96ff52d-1e48-4619-9b72-668628323337 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:47.660088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c96ff52d-1e48-4619-9b72-668628323337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:47.668457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 681/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:47.712554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef789-b5a0-4db7-a574-abc261750ea7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:47.727294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef789-b5a0-4db7-a574-abc261750ea7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:47.732695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:47.733325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:47.733606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:47.733924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:47.744065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:47.745710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307c506-9e67-49c7-8513-ce415a4841be service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:47.755710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 682/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:50.480665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d6eec-0234-483b-91b2-306c247e149b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:50.481151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d6eec-0234-483b-91b2-306c247e149b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:50.481257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d6eec-0234-483b-91b2-306c247e149b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:50.483036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 682/1364] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:50.488263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39e09-1256-4965-aab3-0c2b38edf483 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:50.488639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39e09-1256-4965-aab3-0c2b38edf483 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:50.488815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39e09-1256-4965-aab3-0c2b38edf483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:50.507339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c0c39e09-1256-4965-aab3-0c2b38edf483 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:50.508526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c0c39e09-1256-4965-aab3-0c2b38edf483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:50.516499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 683/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:50.562625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46ae1-59d1-4ffc-bb60-619d4ebb134a None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:50.562981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46ae1-59d1-4ffc-bb60-619d4ebb134a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:50.563324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46ae1-59d1-4ffc-bb60-619d4ebb134a None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:50.565212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 683/1366] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:50.570631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c22-1ba1-420d-aedd-445063c76825 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:50.570925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c22-1ba1-420d-aedd-445063c76825 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:50.571204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c22-1ba1-420d-aedd-445063c76825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:50.589160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ad6f6c22-1ba1-420d-aedd-445063c76825 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:50.590377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ad6f6c22-1ba1-420d-aedd-445063c76825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:50.599398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 684/1367] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:50.608277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d46ae1-59d1-4ffc-bb60-619d4ebb134a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:50.638076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d46ae1-59d1-4ffc-bb60-619d4ebb134a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:50.638076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:50.638076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:50.638076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:50.640223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:50.657354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:50.659226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b85a0-0ade-46a9-870d-9f9539673219 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:50.671316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 684/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:53.105524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2343-cb42-4f13-8b7c-6411a7726c1e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.106483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2343-cb42-4f13-8b7c-6411a7726c1e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.106760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c2343-cb42-4f13-8b7c-6411a7726c1e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.108691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 685/1369] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:53.114069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ad5a-654b-4fed-b0c5-4371b249ebda None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.114508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ad5a-654b-4fed-b0c5-4371b249ebda None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.114626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ad5a-654b-4fed-b0c5-4371b249ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.133974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-eb86ad5a-654b-4fed-b0c5-4371b249ebda None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:53.135176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-eb86ad5a-654b-4fed-b0c5-4371b249ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:53.143408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 685/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:53.201129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef06b5-8490-4df6-85f7-cdc880fff8d1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.201409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef06b5-8490-4df6-85f7-cdc880fff8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.201916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef06b5-8490-4df6-85f7-cdc880fff8d1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.203676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 686/1371] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:53.209122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0ac6a-90d8-4ef2-8955-23c7c85aec57 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.214091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0ac6a-90d8-4ef2-8955-23c7c85aec57 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.214091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0ac6a-90d8-4ef2-8955-23c7c85aec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.228945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f8a0ac6a-90d8-4ef2-8955-23c7c85aec57 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:53.230168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f8a0ac6a-90d8-4ef2-8955-23c7c85aec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:53.238234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 686/1372] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:23:53.282537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef06b5-8490-4df6-85f7-cdc880fff8d1 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:53.298033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef06b5-8490-4df6-85f7-cdc880fff8d1 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:53.305894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:53.306592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.306873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.307195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.315733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:53.317323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fef5c-5f50-461c-92b8-a71c3aae1e4a service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:53.327607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 687/1373] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:53.412877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b9f0-5b80-4c69-b4b7-5a1d8d9d8b28 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.413164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b9f0-5b80-4c69-b4b7-5a1d8d9d8b28 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.413437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b9f0-5b80-4c69-b4b7-5a1d8d9d8b28 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.415296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 687/1374] 10.222.0.24 () {54 vars in 962 bytes} [Fri Mar 25 03:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:53.423833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870e014-28f4-42ca-8315-0ff80f91a244 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.424217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870e014-28f4-42ca-8315-0ff80f91a244 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.424571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870e014-28f4-42ca-8315-0ff80f91a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.478060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5870e014-28f4-42ca-8315-0ff80f91a244 None None] MFA Rules not processed for user `556b5d7a961746acb131a732b62940e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:53.479310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5870e014-28f4-42ca-8315-0ff80f91a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:53.547192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 688/1375] 10.222.0.24 () {58 vars in 1059 bytes} [Fri Mar 25 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:53.556826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b9f0-5b80-4c69-b4b7-5a1d8d9d8b28 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:53.569596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b9f0-5b80-4c69-b4b7-5a1d8d9d8b28 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:53.574457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:53.575615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:53.576068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:53.576504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:53.588200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:53.590159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0a6f4-884d-47c3-a2c6-55a895afebea service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:53.604913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 688/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:55.816158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9d8-cc32-46ff-bc8e-be80ddd18362 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:55.816695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9d8-cc32-46ff-bc8e-be80ddd18362 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:55.816695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9d8-cc32-46ff-bc8e-be80ddd18362 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:55.818472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 689/1377] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:23:55.824086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396698-07f8-42f5-96c3-09f84f1483e2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:55.824520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396698-07f8-42f5-96c3-09f84f1483e2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:55.824665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396698-07f8-42f5-96c3-09f84f1483e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:55.844331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2e396698-07f8-42f5-96c3-09f84f1483e2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:55.845528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2e396698-07f8-42f5-96c3-09f84f1483e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:55.853463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 689/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:55.897949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae9d8-cc32-46ff-bc8e-be80ddd18362 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:55.912406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae9d8-cc32-46ff-bc8e-be80ddd18362 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:55.917426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:55.918092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:55.918372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:55.918656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:55.927195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:55.928786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c75c7-a0f4-4835-aded-83b40e1f8fde service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:55.939856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 690/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:23:58.429987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c8d9-8a04-4e5c-acbe-a5e23af4f76f None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:58.430553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c8d9-8a04-4e5c-acbe-a5e23af4f76f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:58.430553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1c8d9-8a04-4e5c-acbe-a5e23af4f76f None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:58.432388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 690/1380] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:23:58.438668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9803-8990-4a3e-bc01-e89dd305502e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:58.440062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9803-8990-4a3e-bc01-e89dd305502e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:58.440582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9803-8990-4a3e-bc01-e89dd305502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:58.463404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5b2e9803-8990-4a3e-bc01-e89dd305502e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:23:58.464937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b2e9803-8990-4a3e-bc01-e89dd305502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:23:58.474686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 691/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:23:58.518831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c8d9-8a04-4e5c-acbe-a5e23af4f76f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:23:58.532955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1c8d9-8a04-4e5c-acbe-a5e23af4f76f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:23:58.538301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:23:58.538930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:23:58.539211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:23:58.539482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:23:58.547913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:23:58.549505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404545-84f1-4671-a0b7-07ff04bdf1b8 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:23:58.559457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 691/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:01.009263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dd0c-99c1-4201-a032-c276b254a182 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:01.009826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dd0c-99c1-4201-a032-c276b254a182 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:01.009909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dd0c-99c1-4201-a032-c276b254a182 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:01.011635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 692/1383] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:01.016818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d353b-625f-4662-b6c9-3446f9ab48f8 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:01.017658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d353b-625f-4662-b6c9-3446f9ab48f8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:01.018045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d353b-625f-4662-b6c9-3446f9ab48f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:01.035716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-540d353b-625f-4662-b6c9-3446f9ab48f8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:01.037001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-540d353b-625f-4662-b6c9-3446f9ab48f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:01.046313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 692/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:01.087868 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149dd0c-99c1-4201-a032-c276b254a182 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:01.102858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149dd0c-99c1-4201-a032-c276b254a182 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:01.108504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:01.109208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:01.109769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:01.110120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:01.119119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:01.120843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5279fa-ea06-4ea9-9171-5e536b25e2ac service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:01.131077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 693/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:03.494375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6cea-7200-4cc3-b2ca-55d540a7a010 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:03.494970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6cea-7200-4cc3-b2ca-55d540a7a010 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:03.495070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6cea-7200-4cc3-b2ca-55d540a7a010 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:03.497405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 693/1386] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:03.503722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086c4c-22e5-44f4-ab1e-bc7f18f1054b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:03.504181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086c4c-22e5-44f4-ab1e-bc7f18f1054b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:03.504298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086c4c-22e5-44f4-ab1e-bc7f18f1054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:03.522224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-75086c4c-22e5-44f4-ab1e-bc7f18f1054b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:03.523404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-75086c4c-22e5-44f4-ab1e-bc7f18f1054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:03.531055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 694/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:03.575064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee6cea-7200-4cc3-b2ca-55d540a7a010 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:03.592438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee6cea-7200-4cc3-b2ca-55d540a7a010 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:03.598030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:03.598654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:03.598932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:03.599204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:03.607747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:03.609337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac666d-1c27-4074-8a77-e7ce7fb82656 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:03.619255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 694/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:06.066675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f391-a3ba-4e88-8864-90f37d6e4054 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:06.067371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f391-a3ba-4e88-8864-90f37d6e4054 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:06.067371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f391-a3ba-4e88-8864-90f37d6e4054 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:06.068896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 695/1389] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:06.074040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7498-2931-43e0-999b-7c431ae16daf None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:06.074551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7498-2931-43e0-999b-7c431ae16daf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:06.074719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7498-2931-43e0-999b-7c431ae16daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:06.093162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-118f7498-2931-43e0-999b-7c431ae16daf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:06.094393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-118f7498-2931-43e0-999b-7c431ae16daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:06.102679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 695/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:06.145734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4f391-a3ba-4e88-8864-90f37d6e4054 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:06.160507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4f391-a3ba-4e88-8864-90f37d6e4054 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:06.166007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:06.166631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:06.166910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:06.167237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:06.177300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:06.180069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbe701-f7e9-4ebe-9415-0d14c9b7520c service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:06.192489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 696/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:08.712207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e922e-bc69-4fba-b64e-e1dae4c97a19 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:08.713274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e922e-bc69-4fba-b64e-e1dae4c97a19 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:08.713548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e922e-bc69-4fba-b64e-e1dae4c97a19 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:08.716176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 696/1392] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:08.721318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be484a-49a3-4a5e-8b5a-971a291fb31e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:08.721758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be484a-49a3-4a5e-8b5a-971a291fb31e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:08.721904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be484a-49a3-4a5e-8b5a-971a291fb31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:08.739140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-79be484a-49a3-4a5e-8b5a-971a291fb31e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:08.740350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-79be484a-49a3-4a5e-8b5a-971a291fb31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:08.747992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 697/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:08.791533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e922e-bc69-4fba-b64e-e1dae4c97a19 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:08.805878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e922e-bc69-4fba-b64e-e1dae4c97a19 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:08.811141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:08.811770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:08.812047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:08.812319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:08.820688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:08.822321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9fca-1f59-42e8-81ab-9b3e2b23efcf service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:08.831630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 697/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:09.676174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaccc90-72f2-48cb-a837-dddd8e7d179c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:09.676485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaccc90-72f2-48cb-a837-dddd8e7d179c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:09.676761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaccc90-72f2-48cb-a837-dddd8e7d179c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:09.678575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 698/1395] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:24:09.683704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c305e-3412-4665-8d41-af474545b5c1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:09.683993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c305e-3412-4665-8d41-af474545b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:09.684269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c305e-3412-4665-8d41-af474545b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:09.701569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f19c305e-3412-4665-8d41-af474545b5c1 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:09.702857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f19c305e-3412-4665-8d41-af474545b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:09.711381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 698/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:09.766502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283e35-3f05-4806-bcf2-ebaf79b0526c None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:09.767009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283e35-3f05-4806-bcf2-ebaf79b0526c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:09.767115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283e35-3f05-4806-bcf2-ebaf79b0526c None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:09.768772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 699/1397] 10.222.0.24 () {54 vars in 961 bytes} [Fri Mar 25 03:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:09.774348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956329-9878-4d7b-90c7-63ee6c0ef153 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:09.774763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956329-9878-4d7b-90c7-63ee6c0ef153 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:09.774896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956329-9878-4d7b-90c7-63ee6c0ef153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:09.821780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-82956329-9878-4d7b-90c7-63ee6c0ef153 None None] MFA Rules not processed for user `d5e6d8163f1d4451af656c267e6b32c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:09.822964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-82956329-9878-4d7b-90c7-63ee6c0ef153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:09.880386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 699/1398] 10.222.0.24 () {58 vars in 1058 bytes} [Fri Mar 25 03:24:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:09.887751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283e35-3f05-4806-bcf2-ebaf79b0526c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:09.898441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283e35-3f05-4806-bcf2-ebaf79b0526c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:09.901836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:09.902452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:09.902733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:09.903003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:09.911547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:09.913620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd7e89-7750-45b5-9d34-97b385daa55a service glance] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:09.922846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 700/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:10.451968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49e34-bc07-44ce-9091-ac304ee3f136 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:10.452254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49e34-bc07-44ce-9091-ac304ee3f136 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:10.452528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f49e34-bc07-44ce-9091-ac304ee3f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:10.498558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d0f49e34-bc07-44ce-9091-ac304ee3f136 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:10.499733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d0f49e34-bc07-44ce-9091-ac304ee3f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:10.562020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 700/1400] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:10.607207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e0b-951a-4b1f-9ea7-0d68c755ca25 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:10.607615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e0b-951a-4b1f-9ea7-0d68c755ca25 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:10.608017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a4e0b-951a-4b1f-9ea7-0d68c755ca25 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:10.610040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 701/1401] 10.222.0.24 () {54 vars in 942 bytes} [Fri Mar 25 03:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:10.617190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ed5-d6f2-4101-8968-d2937c33bb54 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:10.623884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ed5-d6f2-4101-8968-d2937c33bb54 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:10.623884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ed5-d6f2-4101-8968-d2937c33bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:10.666814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fba75ed5-d6f2-4101-8968-d2937c33bb54 None None] MFA Rules not processed for user `f5956fc6e9b848298d2623b191e841c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:10.667996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fba75ed5-d6f2-4101-8968-d2937c33bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:10.736110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 701/1402] 10.222.0.24 () {58 vars in 1039 bytes} [Fri Mar 25 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:10.745556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a4e0b-951a-4b1f-9ea7-0d68c755ca25 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:10.759120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a4e0b-951a-4b1f-9ea7-0d68c755ca25 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:10.764013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:10.764638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:10.764915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:10.765183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:10.773060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:10.774672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968850ba-a628-47f3-93b4-4736cef0bb2c service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:10.782332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 702/1403] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:24:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:24:11.315855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfa22-d04e-4444-8747-c291acd62b96 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:11.316411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfa22-d04e-4444-8747-c291acd62b96 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:11.316411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfa22-d04e-4444-8747-c291acd62b96 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:11.318174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 702/1404] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:11.323720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5921-0dbf-40b4-9825-1ed9b6c20679 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:11.324009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5921-0dbf-40b4-9825-1ed9b6c20679 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:11.324282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5921-0dbf-40b4-9825-1ed9b6c20679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:11.345354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b29b5921-0dbf-40b4-9825-1ed9b6c20679 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:11.346619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b29b5921-0dbf-40b4-9825-1ed9b6c20679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:11.355519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 703/1405] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:11.402293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfa22-d04e-4444-8747-c291acd62b96 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:11.417868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfa22-d04e-4444-8747-c291acd62b96 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:11.423700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:11.424355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:11.424637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:11.424909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:11.434578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:11.436336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e9a-44f7-4b82-9a22-f9acaa73883e service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:11.447611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 703/1406] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:13.969123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b201-e662-4bbe-93af-728207def398 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:13.969613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b201-e662-4bbe-93af-728207def398 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:13.969820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b201-e662-4bbe-93af-728207def398 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:13.973366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 704/1407] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:13.977772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a9c7-5242-4852-b6c3-0259cbae9630 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:13.978212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a9c7-5242-4852-b6c3-0259cbae9630 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:13.978326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96a9c7-5242-4852-b6c3-0259cbae9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:13.998223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-1e96a9c7-5242-4852-b6c3-0259cbae9630 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:13.998741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1e96a9c7-5242-4852-b6c3-0259cbae9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:14.006763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 704/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:14.049944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4b201-e662-4bbe-93af-728207def398 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:14.064813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4b201-e662-4bbe-93af-728207def398 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:14.070715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:14.071352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:14.071628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:14.071898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:14.080878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:14.082509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cd8ef-ec64-467b-b835-2291201565f0 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:14.095363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 705/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:35.055597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a0e5-c05a-48d3-af64-f07861a8b377 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:35.056240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a0e5-c05a-48d3-af64-f07861a8b377 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:35.056240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698a0e5-c05a-48d3-af64-f07861a8b377 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:35.057996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 705/1410] 10.222.0.24 () {54 vars in 918 bytes} [Fri Mar 25 03:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:35.063119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638bba4-30a6-4957-b9cd-24d305bb3319 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:35.063568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638bba4-30a6-4957-b9cd-24d305bb3319 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:35.063664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638bba4-30a6-4957-b9cd-24d305bb3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:35.080914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2638bba4-30a6-4957-b9cd-24d305bb3319 None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:35.082126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2638bba4-30a6-4957-b9cd-24d305bb3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:35.090539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 706/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Fri Mar 25 03:24:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:35.104611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975af99-d448-45c0-873a-1a85e39c1162 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:35.104898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975af99-d448-45c0-873a-1a85e39c1162 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:35.105176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975af99-d448-45c0-873a-1a85e39c1162 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:35.106994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 706/1412] 10.222.0.24 () {54 vars in 918 bytes} [Fri Mar 25 03:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:35.111244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3108b-65d6-4be8-8269-eb524c671a4c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:35.111525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3108b-65d6-4be8-8269-eb524c671a4c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:35.111799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3108b-65d6-4be8-8269-eb524c671a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:35.129504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9fd3108b-65d6-4be8-8269-eb524c671a4c None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:35.130697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9fd3108b-65d6-4be8-8269-eb524c671a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:35.139443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 707/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Fri Mar 25 03:24:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:37.885482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70d32-406c-4ac7-9bd7-556bb93e4a8c None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:37.885965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70d32-406c-4ac7-9bd7-556bb93e4a8c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:37.886071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70d32-406c-4ac7-9bd7-556bb93e4a8c None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:37.887839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:37.893047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e471-73e9-453d-9d14-bceafda03da4 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:37.893503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e471-73e9-453d-9d14-bceafda03da4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:37.893612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e471-73e9-453d-9d14-bceafda03da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:37.911623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f0c7e471-73e9-453d-9d14-bceafda03da4 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:37.912786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f0c7e471-73e9-453d-9d14-bceafda03da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:37.920275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:37.961865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70d32-406c-4ac7-9bd7-556bb93e4a8c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:37.976156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70d32-406c-4ac7-9bd7-556bb93e4a8c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:37.981362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:37.982014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:37.982293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:37.982561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:37.990489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:37.992057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850368cf-91d9-401c-a9d8-a2f14cc5a3ce service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:38.001147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 708/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:39.339499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1764-7d12-4cff-9a96-45de2d2d1a9a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:39.340039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1764-7d12-4cff-9a96-45de2d2d1a9a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:39.340039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1764-7d12-4cff-9a96-45de2d2d1a9a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:39.341707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:39.346664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1ee3-6876-4179-ac51-de7a35747964 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:39.347098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1ee3-6876-4179-ac51-de7a35747964 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:39.347208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1ee3-6876-4179-ac51-de7a35747964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:39.365838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-970e1ee3-6876-4179-ac51-de7a35747964 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:39.367052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-970e1ee3-6876-4179-ac51-de7a35747964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:39.374701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:39.527413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1764-7d12-4cff-9a96-45de2d2d1a9a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:39.542579 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1764-7d12-4cff-9a96-45de2d2d1a9a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:39.547922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:39.548549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:39.548832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:39.549109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:39.557800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:39.559337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d11aa-31ba-493e-b90e-e87c78729657 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:39.568464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 710/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:40.867056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92916-7584-4926-ad9d-28834103d6e8 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:40.867679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92916-7584-4926-ad9d-28834103d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:40.867679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92916-7584-4926-ad9d-28834103d6e8 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:40.869387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:40.874408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376d7e0-a9d6-40cc-a8ed-4adc32021d42 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:40.874833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376d7e0-a9d6-40cc-a8ed-4adc32021d42 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:40.874986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376d7e0-a9d6-40cc-a8ed-4adc32021d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:40.892884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3376d7e0-a9d6-40cc-a8ed-4adc32021d42 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:40.894102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3376d7e0-a9d6-40cc-a8ed-4adc32021d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:40.902347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:41.050039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92916-7584-4926-ad9d-28834103d6e8 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:41.063871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92916-7584-4926-ad9d-28834103d6e8 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:41.069608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:41.070260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:41.070535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:41.070805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:41.078599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:41.080180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7019ac6-473b-418c-ab09-70d0c74a0f46 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:41.090316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 711/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:42.369980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ea48-3a5b-4f8a-907c-c4a7ac125244 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:42.370534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ea48-3a5b-4f8a-907c-c4a7ac125244 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:42.370534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ea48-3a5b-4f8a-907c-c4a7ac125244 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:42.372301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:42.377215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5524-e1b3-4510-b9ed-a4339d24413f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:42.377628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5524-e1b3-4510-b9ed-a4339d24413f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:42.377788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5524-e1b3-4510-b9ed-a4339d24413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:42.396436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8b0f5524-e1b3-4510-b9ed-a4339d24413f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:42.397603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8b0f5524-e1b3-4510-b9ed-a4339d24413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:42.405171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:42.553477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ea48-3a5b-4f8a-907c-c4a7ac125244 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:42.567888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ea48-3a5b-4f8a-907c-c4a7ac125244 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:42.573252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:42.573881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:42.574162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:42.574436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:42.582257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:42.584466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dc6ef-db75-4375-bab5-6ebcfcaae422 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:42.593873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 713/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:43.882307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3159-497b-41cf-87c1-1e85070ee726 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:43.882779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3159-497b-41cf-87c1-1e85070ee726 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:43.882894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3159-497b-41cf-87c1-1e85070ee726 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:43.884637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:43.889491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1e2-cc7e-4f72-a052-cd94912101fe None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:43.889955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1e2-cc7e-4f72-a052-cd94912101fe None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:43.890060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1e2-cc7e-4f72-a052-cd94912101fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:43.907452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b8f5a1e2-cc7e-4f72-a052-cd94912101fe None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:43.908639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b8f5a1e2-cc7e-4f72-a052-cd94912101fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:43.916723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:44.067728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3159-497b-41cf-87c1-1e85070ee726 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:44.081550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3159-497b-41cf-87c1-1e85070ee726 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:44.087137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:44.087757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:44.088039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:44.088314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:44.096138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:44.097760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401cd06-9b70-4550-972a-4d5622cd6c69 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:44.107378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 714/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:45.440724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9018-7079-4b6d-b54a-d3b77b08561e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:45.441262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9018-7079-4b6d-b54a-d3b77b08561e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:45.441262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9018-7079-4b6d-b54a-d3b77b08561e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:45.443023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:45.447962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916360-f5c8-444c-b0c0-f9fd88a432be None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:45.448395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916360-f5c8-444c-b0c0-f9fd88a432be None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:45.448576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916360-f5c8-444c-b0c0-f9fd88a432be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:45.466534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c4916360-f5c8-444c-b0c0-f9fd88a432be None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:45.467715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c4916360-f5c8-444c-b0c0-f9fd88a432be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:45.476033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:45.625110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9018-7079-4b6d-b54a-d3b77b08561e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:45.639078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9018-7079-4b6d-b54a-d3b77b08561e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:45.644277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:45.644895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:45.645178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:45.646008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:45.653820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:45.655398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81143349-dcba-4b5d-a61e-b2b20266dc96 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:45.665137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 716/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:46.983161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17a05-9be7-4842-b883-da3a7ac2c4b9 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:46.983668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17a05-9be7-4842-b883-da3a7ac2c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:46.983782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17a05-9be7-4842-b883-da3a7ac2c4b9 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:46.985475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:24:46.991010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4161b1-9b0a-472c-9e93-b5e5fd1a0f9b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:46.991442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4161b1-9b0a-472c-9e93-b5e5fd1a0f9b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:46.991547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4161b1-9b0a-472c-9e93-b5e5fd1a0f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:47.009073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2b4161b1-9b0a-472c-9e93-b5e5fd1a0f9b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:47.010281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2b4161b1-9b0a-472c-9e93-b5e5fd1a0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:47.017759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:47.165966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17a05-9be7-4842-b883-da3a7ac2c4b9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:47.180241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17a05-9be7-4842-b883-da3a7ac2c4b9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:47.185562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:47.190744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:47.190744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:47.190744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:47.194579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:47.196148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10a4dc-9537-4577-86ab-99188ba23dd2 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:47.205227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 717/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:48.536317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e938-0fc0-423b-85c9-74ad215b09f1 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:48.536836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e938-0fc0-423b-85c9-74ad215b09f1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:48.536836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e938-0fc0-423b-85c9-74ad215b09f1 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:48.538550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:48.543520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380ac5-4588-4515-becc-3dee79fe7655 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:48.543966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380ac5-4588-4515-becc-3dee79fe7655 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:48.544074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380ac5-4588-4515-becc-3dee79fe7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:48.561771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-52380ac5-4588-4515-becc-3dee79fe7655 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:48.562971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-52380ac5-4588-4515-becc-3dee79fe7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:48.571260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:48.722471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e938-0fc0-423b-85c9-74ad215b09f1 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:48.736349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e938-0fc0-423b-85c9-74ad215b09f1 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:48.742199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:48.742821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:48.743102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:48.743374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:48.751449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:48.753045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ba8db-fbf3-4fb1-b911-dbc2c6aa9cf0 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:48.762778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 719/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:50.068559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613472-e8e6-40a3-8b8e-2bd8ac6f58b2 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:50.069112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613472-e8e6-40a3-8b8e-2bd8ac6f58b2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:50.069112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613472-e8e6-40a3-8b8e-2bd8ac6f58b2 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:50.070911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:50.075921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4cb1-8898-4209-b767-0062714b9894 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:50.076350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4cb1-8898-4209-b767-0062714b9894 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:50.076465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4cb1-8898-4209-b767-0062714b9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:50.094908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-fd5f4cb1-8898-4209-b767-0062714b9894 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:50.096086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fd5f4cb1-8898-4209-b767-0062714b9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:50.103675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:24:50.252175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0613472-e8e6-40a3-8b8e-2bd8ac6f58b2 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:50.269016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0613472-e8e6-40a3-8b8e-2bd8ac6f58b2 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:50.274278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:50.274900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:50.275178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:50.275446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:50.283217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:50.284801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28907ede-f50f-403e-bb90-ce19883be476 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:50.293840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 720/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:52.441217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25177-e8cc-48e5-b925-1b6b4ae8e040 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:52.441807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25177-e8cc-48e5-b925-1b6b4ae8e040 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:52.441807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25177-e8cc-48e5-b925-1b6b4ae8e040 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:52.444675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:52.449772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3f5c-cfe7-4dcb-8208-9f668d38c3f5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:52.450171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3f5c-cfe7-4dcb-8208-9f668d38c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:52.450315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3f5c-cfe7-4dcb-8208-9f668d38c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:52.467734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b8ee3f5c-cfe7-4dcb-8208-9f668d38c3f5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:52.468905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b8ee3f5c-cfe7-4dcb-8208-9f668d38c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:52.476446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:52.513992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d25177-e8cc-48e5-b925-1b6b4ae8e040 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:52.524662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d25177-e8cc-48e5-b925-1b6b4ae8e040 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:52.528163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:52.528785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:52.529068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:52.529342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:52.538051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:52.539489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fe894-ee7f-4775-8889-d131f8642d60 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:52.548651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 722/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:54.953221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2606-05ef-4c1a-93d7-3ec1aea80048 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:54.953916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2606-05ef-4c1a-93d7-3ec1aea80048 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:54.953916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2606-05ef-4c1a-93d7-3ec1aea80048 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:54.955668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:54.961610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015453-5889-46bd-9e09-0fdb108cf6d8 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:54.963360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015453-5889-46bd-9e09-0fdb108cf6d8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:54.963360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015453-5889-46bd-9e09-0fdb108cf6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:54.979654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4e015453-5889-46bd-9e09-0fdb108cf6d8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:54.980919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4e015453-5889-46bd-9e09-0fdb108cf6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:54.988637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:55.027084 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2606-05ef-4c1a-93d7-3ec1aea80048 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:55.038199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2606-05ef-4c1a-93d7-3ec1aea80048 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:55.041600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:55.042249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:55.042527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:55.042798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:55.051947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:55.053380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc71f59-d640-451a-982e-8a3b13a285a6 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:55.062521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 723/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:24:57.755283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55a8e-79a5-450b-b07f-827fda99078a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:57.755846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55a8e-79a5-450b-b07f-827fda99078a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:57.755846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55a8e-79a5-450b-b07f-827fda99078a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:57.757589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:24:57.762796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a0d-17de-4ccf-9112-7ce55286f947 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:57.763209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a0d-17de-4ccf-9112-7ce55286f947 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:57.763344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a0d-17de-4ccf-9112-7ce55286f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:57.781226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-23ab9a0d-17de-4ccf-9112-7ce55286f947 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:24:57.782430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-23ab9a0d-17de-4ccf-9112-7ce55286f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:24:57.790614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:24:57.827683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c55a8e-79a5-450b-b07f-827fda99078a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:24:57.838834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c55a8e-79a5-450b-b07f-827fda99078a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:24:57.842326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:24:57.842946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:24:57.843229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:24:57.843504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:24:57.852697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:24:57.854163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c447f-df41-4c7c-88d0-84ff38e014e5 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:24:57.863247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 725/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:00.258454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755ee8-6d4d-4f17-b1bb-09c38cc0822d None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:00.258985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755ee8-6d4d-4f17-b1bb-09c38cc0822d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:00.258985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755ee8-6d4d-4f17-b1bb-09c38cc0822d None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:00.260734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:00.266183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b6e-4cc6-4240-8cce-8fc5dd3472e8 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:00.267250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b6e-4cc6-4240-8cce-8fc5dd3472e8 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:00.267250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b6e-4cc6-4240-8cce-8fc5dd3472e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:00.284153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3b997b6e-4cc6-4240-8cce-8fc5dd3472e8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:00.285859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3b997b6e-4cc6-4240-8cce-8fc5dd3472e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:00.293640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:25:00.331802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8755ee8-6d4d-4f17-b1bb-09c38cc0822d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:00.343508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8755ee8-6d4d-4f17-b1bb-09c38cc0822d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:00.347031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:00.347663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:00.347941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:00.348215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:00.356954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:00.358433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02fe6e-4611-40b2-a042-8093d72f3a42 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:00.367897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 726/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:02.755661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18a3a-eb8f-4a98-85fc-20300b698c61 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:02.756237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18a3a-eb8f-4a98-85fc-20300b698c61 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:02.756237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18a3a-eb8f-4a98-85fc-20300b698c61 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:02.758070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:02.763412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9181-353b-4205-b9f4-2d4f8d843571 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:02.763854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9181-353b-4205-b9f4-2d4f8d843571 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:02.763957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9181-353b-4205-b9f4-2d4f8d843571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:02.781157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bd3f9181-353b-4205-b9f4-2d4f8d843571 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:02.782672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bd3f9181-353b-4205-b9f4-2d4f8d843571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:02.790754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:02.827887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18a3a-eb8f-4a98-85fc-20300b698c61 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:02.838572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18a3a-eb8f-4a98-85fc-20300b698c61 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:02.841990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:02.842608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:02.842890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:02.843162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:02.852214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:02.853633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8963d3-b8ff-4ca5-b2c2-a8d8fa163aaa service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:02.862761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 728/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:05.185693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e953-cecb-4c19-ac47-37424d5bf7b7 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:05.186246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e953-cecb-4c19-ac47-37424d5bf7b7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:05.186349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e953-cecb-4c19-ac47-37424d5bf7b7 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:05.188102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:05.193512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b601e-dcd3-4c9b-b909-223a7479b49d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:05.193977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b601e-dcd3-4c9b-b909-223a7479b49d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:05.194081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b601e-dcd3-4c9b-b909-223a7479b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:05.217362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b14b601e-dcd3-4c9b-b909-223a7479b49d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:05.217362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b14b601e-dcd3-4c9b-b909-223a7479b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:05.221032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:05.258979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6e953-cecb-4c19-ac47-37424d5bf7b7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:05.270299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6e953-cecb-4c19-ac47-37424d5bf7b7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:05.273867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:05.274501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:05.274782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:05.275057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:05.284088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:05.285602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fcf5b-b85f-4598-8f02-ddf3da9f3cd6 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:05.295903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 729/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:07.641018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924ca0-56a5-4257-87b8-f0adeba01acd None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:07.641617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924ca0-56a5-4257-87b8-f0adeba01acd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:07.641617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924ca0-56a5-4257-87b8-f0adeba01acd None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:07.643352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:07.649019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eebf8-63e2-41c3-9056-ace598c76443 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:07.649443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eebf8-63e2-41c3-9056-ace598c76443 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:07.649592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eebf8-63e2-41c3-9056-ace598c76443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:07.667543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-365eebf8-63e2-41c3-9056-ace598c76443 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:07.668714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-365eebf8-63e2-41c3-9056-ace598c76443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:07.676395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:07.713776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0924ca0-56a5-4257-87b8-f0adeba01acd None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:07.724739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0924ca0-56a5-4257-87b8-f0adeba01acd None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:07.728185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:07.728805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:07.729086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:07.729358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:07.737978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:07.739429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3a056-1f3a-45c1-a092-94a0cbbff057 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:07.748468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 731/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:10.091690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd86a-4429-47bb-9211-c01ba5c95bbe None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:10.091690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd86a-4429-47bb-9211-c01ba5c95bbe None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:10.091690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd86a-4429-47bb-9211-c01ba5c95bbe None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:10.093202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:10.098943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9c7b-62b4-45f1-baa9-bc0cda9dc67a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:10.099454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9c7b-62b4-45f1-baa9-bc0cda9dc67a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:10.099549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9c7b-62b4-45f1-baa9-bc0cda9dc67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:10.117506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-edef9c7b-62b4-45f1-baa9-bc0cda9dc67a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:10.118781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-edef9c7b-62b4-45f1-baa9-bc0cda9dc67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:10.126353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:10.163259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd86a-4429-47bb-9211-c01ba5c95bbe None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:10.173828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd86a-4429-47bb-9211-c01ba5c95bbe None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:10.178229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:10.178862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:10.179151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:10.179425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:10.188342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:10.189815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97e916-eb40-47f3-81c4-f576a60f59d0 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:10.199122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 732/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:12.474010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47151909-9512-41b6-8be3-da1ce8236976 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:12.474547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47151909-9512-41b6-8be3-da1ce8236976 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:12.474547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47151909-9512-41b6-8be3-da1ce8236976 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:12.476366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:12.481521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3132e-88bc-40bd-99b5-686e6f3898a9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:12.481995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3132e-88bc-40bd-99b5-686e6f3898a9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:12.482121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3132e-88bc-40bd-99b5-686e6f3898a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:12.499990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-97c3132e-88bc-40bd-99b5-686e6f3898a9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:12.501157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-97c3132e-88bc-40bd-99b5-686e6f3898a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:12.508728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:12.544434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47151909-9512-41b6-8be3-da1ce8236976 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:12.555689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47151909-9512-41b6-8be3-da1ce8236976 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:12.559183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:12.559800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:12.560076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:12.560345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:12.569275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:12.570765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4212cc-929b-4e3a-9b46-a1756c44f18a service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:12.580130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 734/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:14.870132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9323d-88b7-4c28-90bd-5bad59c528e6 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:14.870721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9323d-88b7-4c28-90bd-5bad59c528e6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:14.870721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9323d-88b7-4c28-90bd-5bad59c528e6 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:14.872472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:14.877796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef9ba-77a6-403b-bb70-3d1964f084b3 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:14.878224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef9ba-77a6-403b-bb70-3d1964f084b3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:14.878353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef9ba-77a6-403b-bb70-3d1964f084b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:14.897612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9cfef9ba-77a6-403b-bb70-3d1964f084b3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:14.898822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9cfef9ba-77a6-403b-bb70-3d1964f084b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:14.906426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:14.943380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9323d-88b7-4c28-90bd-5bad59c528e6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:14.953886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9323d-88b7-4c28-90bd-5bad59c528e6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:14.957405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:14.958125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:14.958401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:14.958689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:14.967931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:14.969374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dcc52-bf42-4dfc-ba21-915bd3228555 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:14.979264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 735/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:35.479556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7937e1-ed9f-4ef4-b79d-72c8af5a55e0 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:35.480159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7937e1-ed9f-4ef4-b79d-72c8af5a55e0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:35.480159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7937e1-ed9f-4ef4-b79d-72c8af5a55e0 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:35.481876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 736/1471] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:35.487517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1abd5-6e49-4e94-acf8-462602e7ae85 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:35.487950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1abd5-6e49-4e94-acf8-462602e7ae85 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:35.488051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1abd5-6e49-4e94-acf8-462602e7ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:35.506990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-92b1abd5-6e49-4e94-acf8-462602e7ae85 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:35.508178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-92b1abd5-6e49-4e94-acf8-462602e7ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:35.516015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 736/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:25:35.561357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57e7a9-2169-4df4-8849-49648389aa06 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:35.561641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57e7a9-2169-4df4-8849-49648389aa06 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:35.561944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57e7a9-2169-4df4-8849-49648389aa06 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:35.563657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 737/1473] 10.222.0.24 () {54 vars in 961 bytes} [Fri Mar 25 03:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:35.568276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bff9c-2a64-4cc3-be09-973990993528 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:35.568593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bff9c-2a64-4cc3-be09-973990993528 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:35.568863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bff9c-2a64-4cc3-be09-973990993528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:35.586890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-721bff9c-2a64-4cc3-be09-973990993528 None None] MFA Rules not processed for user `d5e6d8163f1d4451af656c267e6b32c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:35.588049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-721bff9c-2a64-4cc3-be09-973990993528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:35.594343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 737/1474] 10.222.0.24 () {58 vars in 1058 bytes} [Fri Mar 25 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:35.601829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57e7a9-2169-4df4-8849-49648389aa06 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:35.612551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57e7a9-2169-4df4-8849-49648389aa06 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:35.616011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:35.616617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:35.616896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:35.617166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:35.625754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:35.627174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce204bd-ce91-4c28-8f9f-577cac1e27de service glance] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:35.636421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 738/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:37.998364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973df9b-e3d5-4ec1-abf8-56e8d807c451 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:37.998879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973df9b-e3d5-4ec1-abf8-56e8d807c451 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:37.998879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973df9b-e3d5-4ec1-abf8-56e8d807c451 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:38.000662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 738/1476] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:38.005876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945a72-6b1e-43c7-8b9c-a51b77574421 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:38.006320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945a72-6b1e-43c7-8b9c-a51b77574421 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:38.006435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945a72-6b1e-43c7-8b9c-a51b77574421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:38.023568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-aa945a72-6b1e-43c7-8b9c-a51b77574421 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:38.024747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aa945a72-6b1e-43c7-8b9c-a51b77574421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:38.032328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 739/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:38.055935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973df9b-e3d5-4ec1-abf8-56e8d807c451 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:38.067913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973df9b-e3d5-4ec1-abf8-56e8d807c451 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:38.072307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:38.072930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:38.073207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:38.073474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:38.074227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:38.075932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:25:38.075932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:25:38.075932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:25:38.077064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a583f0-7bfc-4e2d-a7d4-84a87474fd9a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:38.095523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 739/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Fri Mar 25 03:25:38 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:25:40.387004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060ad4c-ca56-48ed-8496-bfc5d9cd5738 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:40.387593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060ad4c-ca56-48ed-8496-bfc5d9cd5738 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:40.387593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060ad4c-ca56-48ed-8496-bfc5d9cd5738 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:40.389323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 740/1479] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:40.394981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1526-2f68-4fea-b88f-403099386a24 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:40.395417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1526-2f68-4fea-b88f-403099386a24 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:40.395527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1526-2f68-4fea-b88f-403099386a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:40.413289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b03a1526-2f68-4fea-b88f-403099386a24 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:40.414519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b03a1526-2f68-4fea-b88f-403099386a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:40.422180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 740/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:40.464240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060ad4c-ca56-48ed-8496-bfc5d9cd5738 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:40.478081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060ad4c-ca56-48ed-8496-bfc5d9cd5738 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:40.483418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:40.484036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:40.484315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:40.484583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:40.492899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:40.494502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225167cb-76ce-4567-bba0-345d6df8c10a service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:40.504164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 741/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:42.963392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28ebf-6686-4a53-a46a-7d2b52ec9013 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:42.963846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28ebf-6686-4a53-a46a-7d2b52ec9013 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:42.963988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28ebf-6686-4a53-a46a-7d2b52ec9013 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:42.965805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 741/1482] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:42.970847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962756-74a4-47b8-9495-0bed7c409f55 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:42.971281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962756-74a4-47b8-9495-0bed7c409f55 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:42.971421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962756-74a4-47b8-9495-0bed7c409f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:42.989804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-be962756-74a4-47b8-9495-0bed7c409f55 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:42.990890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-be962756-74a4-47b8-9495-0bed7c409f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:42.998763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 742/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:43.034977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28ebf-6686-4a53-a46a-7d2b52ec9013 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:43.045467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28ebf-6686-4a53-a46a-7d2b52ec9013 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:43.048965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:43.050152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:43.050432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:43.050709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:43.059499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:43.060942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e050e5-76a3-4071-9ef0-730077f38b48 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:43.070279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 742/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:45.438272 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe259e0-98ab-4848-9608-ed27216f9c4e None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:45.438805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe259e0-98ab-4848-9608-ed27216f9c4e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:45.438805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe259e0-98ab-4848-9608-ed27216f9c4e None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:45.440523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 743/1485] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:45.445735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3e1e-b26c-4fd7-98e9-6b064c630001 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:45.446184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3e1e-b26c-4fd7-98e9-6b064c630001 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:45.446283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3e1e-b26c-4fd7-98e9-6b064c630001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:45.464313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-05be3e1e-b26c-4fd7-98e9-6b064c630001 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:45.465495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-05be3e1e-b26c-4fd7-98e9-6b064c630001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:45.473588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 743/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:45.510958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe259e0-98ab-4848-9608-ed27216f9c4e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:45.521243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe259e0-98ab-4848-9608-ed27216f9c4e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:45.524703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:45.525322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:45.525601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:45.525906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:45.535059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:45.536483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc41813-4e82-4427-8a3b-c9a5fbb08afe service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:45.545584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 744/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:48.038086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa896-19e9-42c1-8c63-b51bf68b0a35 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:48.038614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa896-19e9-42c1-8c63-b51bf68b0a35 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:48.038718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa896-19e9-42c1-8c63-b51bf68b0a35 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:48.040424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 744/1488] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:48.045472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255ecea-e643-4458-80b8-091922cdf250 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:48.045932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255ecea-e643-4458-80b8-091922cdf250 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:48.046049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255ecea-e643-4458-80b8-091922cdf250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:48.063146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1255ecea-e643-4458-80b8-091922cdf250 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:48.064340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1255ecea-e643-4458-80b8-091922cdf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:48.071912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 745/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:25:48.112018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aa896-19e9-42c1-8c63-b51bf68b0a35 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:48.122634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aa896-19e9-42c1-8c63-b51bf68b0a35 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:48.126018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:48.126634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:48.127010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:48.127493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:48.135984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:48.137412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f222c2-d966-47cc-ba8e-02f889805538 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:48.146971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 745/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:25:50.784523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421dd1-5757-408d-827e-c27599b32c33 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:50.785063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421dd1-5757-408d-827e-c27599b32c33 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:50.785063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31421dd1-5757-408d-827e-c27599b32c33 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:50.786852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 746/1491] 10.222.0.24 () {54 vars in 926 bytes} [Fri Mar 25 03:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:25:50.791893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536db8-cfee-499c-80ce-6d9a18b1a281 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:50.792295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536db8-cfee-499c-80ce-6d9a18b1a281 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:50.792471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536db8-cfee-499c-80ce-6d9a18b1a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:50.810662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f3536db8-cfee-499c-80ce-6d9a18b1a281 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:25:50.811836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f3536db8-cfee-499c-80ce-6d9a18b1a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:25:50.819510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 746/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Fri Mar 25 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:25:50.858301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31421dd1-5757-408d-827e-c27599b32c33 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:25:50.869365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31421dd1-5757-408d-827e-c27599b32c33 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:25:50.872890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:25:50.873511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:25:50.873843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:25:50.874125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:25:50.882762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:25:50.884187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d78bdd-6a2e-4f4d-b5bf-1f24610fdfe5 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:25:50.893744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 747/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:27:19.798289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:19.798920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:19.798920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:19.816624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:27:19.817839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:19.825491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 747/1494] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:27:19.834552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:19.835046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:19.835146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:19.853440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:27:19.854658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:19.862919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 748/1495] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:27:19.867452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:19.876841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5498c0f-ac92-4997-8bc0-6cb93cdeb051 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:19.881321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:19.881996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:19.882273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:19.882542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:19.883243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:27:19.883541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:19.884550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:19.884550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:27:19.884550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:27:19.885426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:19.896444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 748/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:27:19.904639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:19.913566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03ce9-be87-4254-9c31-df916fa0b831 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:19.918078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:19.918740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:19.919022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:19.919294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:19.920525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:19.922281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:19.922281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:27:19.922281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:27:19.923470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.031980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 749/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:27:19 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:27:20.036168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.046682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878dfd1-756d-4f90-bcf3-e6833ad34a66 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.102235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.102896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.103178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.103450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.104139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.105153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:20.105153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:27:20.105153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:27:20.106390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.189346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 749/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:27:20 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:27:20.193600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.204026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000d8d-0105-4470-9d48-7d3f3810b884 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.208417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.209058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.209340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.209612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.210360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.211621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:20.211621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:27:20.211621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:27:20.212503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.225375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 750/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:27:20.229188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.239177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f44ff-fa41-4215-b83b-d2a728e8463f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.243783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.244658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.244908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.245014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.245724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.246734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:20.246734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:27:20.246734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:27:20.247616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed613b0-d2a4-4e75-b0b6-a90af4e48eec admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.260549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 750/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:27:20.264990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.274500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195004-c103-49cc-9cad-43ca92d712e1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.278957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.280429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.280730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.280979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] PATH_INFO: `/v3/projects/103a789b82b54206bc5f4afeb776e44a/users/03cf7f5c673549f19dcaf8f3cfb02591/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.295490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=103a789b82b54206bc5f4afeb776e44a, user_id=03cf7f5c673549f19dcaf8f3cfb02591, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.296506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:20.296506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:27:20.296506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:27:20.298509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.396039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 751/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:27:20 2022] PUT /identity/v3/projects/103a789b82b54206bc5f4afeb776e44a/users/03cf7f5c673549f19dcaf8f3cfb02591/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:27:20.407822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13582e8-01ab-4798-84d5-c8f3188712da None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.408106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13582e8-01ab-4798-84d5-c8f3188712da None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.408381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13582e8-01ab-4798-84d5-c8f3188712da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.434182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b13582e8-01ab-4798-84d5-c8f3188712da None None] MFA Rules not processed for user `03cf7f5c673549f19dcaf8f3cfb02591`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:27:20.435443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b13582e8-01ab-4798-84d5-c8f3188712da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:20.496325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 751/1502] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:27:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:27:20.507778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.574765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977410-0bd0-4725-beb6-279a64e05dcd admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.580775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.581408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.581714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.581994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.589968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.591622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.600331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 752/1503] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:27:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:27:20.670337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424aa42-6d8b-413a-bc3c-659df5787fc2 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.670653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424aa42-6d8b-413a-bc3c-659df5787fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.670933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424aa42-6d8b-413a-bc3c-659df5787fc2 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.674989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 752/1504] 10.222.0.24 () {52 vars in 829 bytes} [Fri Mar 25 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:27:20.677706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:20.736451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c699a7-a333-45a3-ada3-38e09de2d97e service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:20.740970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:20.741847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:20.742131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:20.742403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] PATH_INFO: `/v3/users/03cf7f5c673549f19dcaf8f3cfb02591` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:20.743558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cf7f5c673549f19dcaf8f3cfb02591)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:20.744554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:20.744554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:27:20.744554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:27:20.745789 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:20.944378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cf7f5c673549f19dcaf8f3cfb02591'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:20.956001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cf7f5c673549f19dcaf8f3cfb02591'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.034494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cf7f5c673549f19dcaf8f3cfb02591'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.053051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cf7f5c673549f19dcaf8f3cfb02591'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.053734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cf7f5c673549f19dcaf8f3cfb02591'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.059936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 753/1505] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:27:20 2022] DELETE /identity/v3/users/03cf7f5c673549f19dcaf8f3cfb02591 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:27:21.064997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:21.067152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:21.067152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:21.082539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:27:21.083721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:21.140746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 753/1506] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:27:21.150187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:21.151639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:21.205263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d68a-7389-4ed0-8775-064469bf5dec admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:21.208686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:21.209311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:21.209588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:21.209890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:21.218529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:21.219953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52e49-b77f-454b-aaf0-fd15bc82167e service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:21.228862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 754/1507] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:27:21.728961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:27:21.730593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:27:21.742733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e3308-504a-41fa-848a-7607d1298d0c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:27:21.747140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:27:21.748023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:27:21.748302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:27:21.748641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] PATH_INFO: `/v3/projects/103a789b82b54206bc5f4afeb776e44a` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:27:21.749880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103a789b82b54206bc5f4afeb776e44a)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:27:21.750912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:27:21.750912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:27:21.750912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:27:21.752118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:27:21.873766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103a789b82b54206bc5f4afeb776e44a', 'request_id': 'req-472fd2f4-698b-4bea-a856-1482edf03052'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.880093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103a789b82b54206bc5f4afeb776e44a', 'request_id': 'req-472fd2f4-698b-4bea-a856-1482edf03052'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:21.893436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103a789b82b54206bc5f4afeb776e44a', 'request_id': 'req-472fd2f4-698b-4bea-a856-1482edf03052'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:22.001396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] The token cache is being invalidate because project 103a789b82b54206bc5f4afeb776e44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:27:22.001618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:22.002380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-472fd2f4-698b-4bea-a856-1482edf03052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:27:22.004080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 754/1508] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:27:21 2022] DELETE /identity/v3/projects/103a789b82b54206bc5f4afeb776e44a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:28:54.953407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:54.954065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:54.954241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:54.956277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 755/1509] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:28:54.962654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0528-d5fc-4ac4-ba25-713288e9cdca None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:54.968981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0528-d5fc-4ac4-ba25-713288e9cdca None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:54.968981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0528-d5fc-4ac4-ba25-713288e9cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:54.983051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-583b0528-d5fc-4ac4-ba25-713288e9cdca None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:28:54.984267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-583b0528-d5fc-4ac4-ba25-713288e9cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:28:55.040626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 755/1510] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:28:55.196775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:28:55.198902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:28:55.266891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2367-f973-40fd-954d-a06aafa11a32 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:55.267134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2367-f973-40fd-954d-a06aafa11a32 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:55.267355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2367-f973-40fd-954d-a06aafa11a32 None None] PATH_INFO: `/v3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:55.268681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 756/1511] 10.222.0.35 () {54 vars in 925 bytes} [Fri Mar 25 03:28:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:28:55.273901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc69966-b767-4ed5-b1fd-484178964e11 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:28:55.275016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560886c-b212-45d3-8183-87f14bf57df2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:55.275367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560886c-b212-45d3-8183-87f14bf57df2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:55.275711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560886c-b212-45d3-8183-87f14bf57df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:55.279657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:28:55.280286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:55.280566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:55.280841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:55.288713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:28:55.290337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27a41-1a57-40c3-8784-9d2a518c0217 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:28:55.294160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7560886c-b212-45d3-8183-87f14bf57df2 None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:28:55.295393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7560886c-b212-45d3-8183-87f14bf57df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:28:55.299704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 756/1512] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:28:55.359857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 757/1513] 10.222.0.35 () {58 vars in 1015 bytes} [Fri Mar 25 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:28:56.584762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fe483-3411-4ebd-b994-cdf6cbf2717b None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:56.585374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fe483-3411-4ebd-b994-cdf6cbf2717b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:56.585374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fe483-3411-4ebd-b994-cdf6cbf2717b None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:56.587339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:28:56.593718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b028e0-28ca-4163-9f6d-28fcce8cc596 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:56.593718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b028e0-28ca-4163-9f6d-28fcce8cc596 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:56.593718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b028e0-28ca-4163-9f6d-28fcce8cc596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:56.611524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b6b028e0-28ca-4163-9f6d-28fcce8cc596 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:28:56.612695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b6b028e0-28ca-4163-9f6d-28fcce8cc596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:28:56.620339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:28:56.769844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fe483-3411-4ebd-b994-cdf6cbf2717b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:28:56.784002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fe483-3411-4ebd-b994-cdf6cbf2717b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:28:56.789190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:28:56.789839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:56.790120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:56.790388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:56.798740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:28:56.800296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424168b-2c82-4191-9c82-11e658695816 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:28:56.809361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 758/1516] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:28:59.464663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ecea-ee2d-485c-a4a8-4304d38a54e6 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:59.465223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ecea-ee2d-485c-a4a8-4304d38a54e6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:59.465223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ecea-ee2d-485c-a4a8-4304d38a54e6 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:59.467081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 759/1517] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:28:59.472205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218db9e-0934-4eb7-a036-408e5acf0bfd None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:59.472616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218db9e-0934-4eb7-a036-408e5acf0bfd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:59.472899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218db9e-0934-4eb7-a036-408e5acf0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:59.491649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3218db9e-0934-4eb7-a036-408e5acf0bfd None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:28:59.492856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3218db9e-0934-4eb7-a036-408e5acf0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:28:59.501279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 759/1518] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:28:59.508629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ecea-ee2d-485c-a4a8-4304d38a54e6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:28:59.522373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ecea-ee2d-485c-a4a8-4304d38a54e6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:28:59.528167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:28:59.528795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:28:59.529073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:28:59.529345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:28:59.537414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:28:59.539047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4d7d-2b9f-4f6a-a2e9-7e7365c4c6ff service placement] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:28:59.548976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 760/1519] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:28:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:08.493268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9005-55a8-405d-9dd9-00e5ee36acf7 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:08.493883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9005-55a8-405d-9dd9-00e5ee36acf7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:08.493883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9005-55a8-405d-9dd9-00e5ee36acf7 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:08.496116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 760/1520] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:08.501082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67e89-8cbd-43d4-b35e-06d397bc8aaf None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:08.501504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67e89-8cbd-43d4-b35e-06d397bc8aaf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:08.501611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e67e89-8cbd-43d4-b35e-06d397bc8aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:08.521122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b7e67e89-8cbd-43d4-b35e-06d397bc8aaf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:08.522344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b7e67e89-8cbd-43d4-b35e-06d397bc8aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:08.530118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 761/1521] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:08.679837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9005-55a8-405d-9dd9-00e5ee36acf7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:08.694112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9005-55a8-405d-9dd9-00e5ee36acf7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:08.700096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:08.700719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:08.700995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:08.701266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:08.709162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:08.710785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eb36f-5c69-4309-b7da-0ada7787c7e0 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:08.720784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 761/1522] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:09.980071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d2c3-128f-44cc-af76-c8d6425fd4bb None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:09.980553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d2c3-128f-44cc-af76-c8d6425fd4bb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:09.980660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d2c3-128f-44cc-af76-c8d6425fd4bb None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:09.982421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 762/1523] 127.0.0.1 () {54 vars in 901 bytes} [Fri Mar 25 03:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:09.987173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edecae0-03c2-43f6-a659-896fa99248bb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:09.987595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edecae0-03c2-43f6-a659-896fa99248bb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:09.987720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edecae0-03c2-43f6-a659-896fa99248bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:10.005017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8edecae0-03c2-43f6-a659-896fa99248bb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:10.006213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8edecae0-03c2-43f6-a659-896fa99248bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:10.013758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 762/1524] 127.0.0.1 () {58 vars in 998 bytes} [Fri Mar 25 03:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:10.164197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d2c3-128f-44cc-af76-c8d6425fd4bb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:10.178303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d2c3-128f-44cc-af76-c8d6425fd4bb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:10.184377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:10.184994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:10.185270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:10.185541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:10.194032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:10.195659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44879303-4377-46c4-a003-c4cfad7a7189 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:10.205450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 763/1525] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:14.381649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:14.382236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:14.382236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:14.383981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 763/1526] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:14.389107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db09d-1223-4549-9574-840704df7156 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:14.389565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db09d-1223-4549-9574-840704df7156 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:14.389704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db09d-1223-4549-9574-840704df7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:14.407124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e62db09d-1223-4549-9574-840704df7156 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:14.408292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e62db09d-1223-4549-9574-840704df7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:14.416662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 764/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:14.452434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:14.454095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:14.509077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f2503-5209-477d-93b4-8bb9ac7330da None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:14.512504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:14.513126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:14.513408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:14.513706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:14.522252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:14.523675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a188492-44c4-4014-a416-7fc598036dca service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:14.533275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 764/1528] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:16.819343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3247-492a-4814-8fa4-18780118a675 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:16.819913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3247-492a-4814-8fa4-18780118a675 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:16.819913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3247-492a-4814-8fa4-18780118a675 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:16.821700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 765/1529] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:16.827550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecede-8387-4823-b389-657e977a65c0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:16.827960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecede-8387-4823-b389-657e977a65c0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:16.828105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecede-8387-4823-b389-657e977a65c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:16.845952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-884ecede-8387-4823-b389-657e977a65c0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:16.847138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-884ecede-8387-4823-b389-657e977a65c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:16.854829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 765/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:16.890978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3247-492a-4814-8fa4-18780118a675 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:16.901819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3247-492a-4814-8fa4-18780118a675 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:16.905269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:16.905922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:16.906203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:16.906479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:16.915128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:16.916571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7bc2d-1a6c-4ea1-9994-44dcb4a86d7b service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:16.925897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 766/1531] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:20.656934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:20.657507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:20.657507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:20.659320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 766/1532] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:20.664403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5c25-d7e1-4aa3-9e20-e0b03db45e3f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:20.664888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5c25-d7e1-4aa3-9e20-e0b03db45e3f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:20.665003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5c25-d7e1-4aa3-9e20-e0b03db45e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:20.683629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0a8f5c25-d7e1-4aa3-9e20-e0b03db45e3f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:20.684803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0a8f5c25-d7e1-4aa3-9e20-e0b03db45e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:20.692604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 767/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:20.944729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:20.946390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:21.001526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47b1d-9ab9-4618-be3f-f10191a46bed None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:21.005032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:21.005680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:21.005973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:21.006245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:21.015536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:21.016958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33474b-fc2e-4582-a694-ad76e9c5e2b6 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:21.026605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 767/1534] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:29:23.327224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1e97-2439-4159-a730-86c00b7f1166 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:23.327720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1e97-2439-4159-a730-86c00b7f1166 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:23.327831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1e97-2439-4159-a730-86c00b7f1166 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:23.329561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 768/1535] 127.0.0.1 () {54 vars in 916 bytes} [Fri Mar 25 03:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:23.334756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f4b8-97e3-42f3-95e6-06eb333dbcd9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:23.335204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f4b8-97e3-42f3-95e6-06eb333dbcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:23.335310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f4b8-97e3-42f3-95e6-06eb333dbcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:23.352984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3301f4b8-97e3-42f3-95e6-06eb333dbcd9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:23.354713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3301f4b8-97e3-42f3-95e6-06eb333dbcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:23.362246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 768/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Mar 25 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:29:23.615594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474375f-b126-4773-8bdf-f0c9d3e200c0 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:23.615877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474375f-b126-4773-8bdf-f0c9d3e200c0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:23.616150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474375f-b126-4773-8bdf-f0c9d3e200c0 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:23.617947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 769/1537] 10.222.0.24 () {54 vars in 962 bytes} [Fri Mar 25 03:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:29:23.622856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e59e-9611-4c8a-81b5-c1b7c4b2972f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:23.623149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e59e-9611-4c8a-81b5-c1b7c4b2972f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:23.623428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e59e-9611-4c8a-81b5-c1b7c4b2972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:23.640998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dbb1e59e-9611-4c8a-81b5-c1b7c4b2972f None None] MFA Rules not processed for user `556b5d7a961746acb131a732b62940e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:29:23.642209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dbb1e59e-9611-4c8a-81b5-c1b7c4b2972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:29:23.648480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 769/1538] 10.222.0.24 () {58 vars in 1059 bytes} [Fri Mar 25 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:29:23.657957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474375f-b126-4773-8bdf-f0c9d3e200c0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:29:23.669120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474375f-b126-4773-8bdf-f0c9d3e200c0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:29:23.672520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:29:23.673146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:29:23.673426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:29:23.673715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:29:23.683940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:29:23.685535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b40c9-c4ce-405a-aeca-e7306aa1ed08 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:29:23.695465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 770/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:51.480283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.481408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.481942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.507318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:51.508878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:51.519795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 770/1540] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:51.529881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.530893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.531387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.557269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:51.559483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:51.571735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 771/1541] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:51.576574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:51.589655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc5cf8-255d-4e9f-ab1e-e1c745081154 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:51.598009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:51.598674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.598956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.599230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.599951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:51.600256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:51.601277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:30:51.601277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:30:51.601277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:30:51.602192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:51.621393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 771/1542] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:51.629361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:51.643530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5b4e6-1ed1-4003-9a22-665afe7c5ec8 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:51.648693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:51.649637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.650197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.650688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.651626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:51.652871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:30:51.652871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:30:51.652871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:30:51.658126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:51.764174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 772/1543] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:51 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:51.768859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:51.781877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6acb21-49c6-4b1c-b5d7-97b9840288ce admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:51.871522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:51.872508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.872955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.873398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.874273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:51.875460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:30:51.875460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:30:51.875460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:30:51.877184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34166-b79d-4747-8085-08fcc7a36c04 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:51.945636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 772/1544] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:51 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:30:51.950036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:51.964631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656dd4-6559-42dd-a09f-c0eb4ff97c88 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.964631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656dd4-6559-42dd-a09f-c0eb4ff97c88 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.964631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656dd4-6559-42dd-a09f-c0eb4ff97c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.965733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5bb5-6add-46a3-b8ae-97aa1a95d806 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:51.983498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:51.984490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:51.985010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:51.985522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:51.986942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:51.988864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:51.997861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f9656dd4-6559-42dd-a09f-c0eb4ff97c88 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:51.999234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f9656dd4-6559-42dd-a09f-c0eb4ff97c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.012530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 773/1545] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:52.014451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 773/1546] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.018222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.025688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcf2d4-8562-46a1-9285-49cd277372fc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.025688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcf2d4-8562-46a1-9285-49cd277372fc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.025688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcf2d4-8562-46a1-9285-49cd277372fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.035248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70714-b644-4872-a00d-aa7e59cf663f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.047034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.048401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.048913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.049395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.050358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.052192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca9c1-5ee4-473d-95c9-9ff138048355 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.058928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-79fcf2d4-8562-46a1-9285-49cd277372fc None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.061684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-79fcf2d4-8562-46a1-9285-49cd277372fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.075603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 774/1547] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:52.081693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.081909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 774/1548] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:30:52.082025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.082025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.082211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2700-75a2-451f-aac5-d72476287723 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.082211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2700-75a2-451f-aac5-d72476287723 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.082211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2700-75a2-451f-aac5-d72476287723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.119696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-081f2700-75a2-451f-aac5-d72476287723 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.124930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.125469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-081f2700-75a2-451f-aac5-d72476287723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.126056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.134359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 775/1549] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.135654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f2700-75a2-451f-aac5-d72476287723 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.135781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 775/1550] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.136784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.145926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f2700-75a2-451f-aac5-d72476287723 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.148788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6783-0b09-483e-80a4-958d836792be None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.155099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.155290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.155764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.156046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.156159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.156316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.156431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.156639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] PATH_INFO: `/v3/projects/eb7222adc16e4fffa44214043ad0c7ad/users/556f14d079254d7e91fc1e942e2a30a4/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.157032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.157334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.159071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a8ef-3a0a-4416-81e2-217f0f685c22 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.172232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 776/1551] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.173732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca23ad-b21e-4077-b485-93f497931e8f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.174095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca23ad-b21e-4077-b485-93f497931e8f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.174445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca23ad-b21e-4077-b485-93f497931e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.178405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7222adc16e4fffa44214043ad0c7ad, user_id=556f14d079254d7e91fc1e942e2a30a4, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.182957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a05e0-7655-4e7a-af42-9525649ca6f9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.192508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-54ca23ad-b21e-4077-b485-93f497931e8f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.193765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-54ca23ad-b21e-4077-b485-93f497931e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.202350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 777/1552] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.203749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816620f3-0f0e-4ae5-b341-cbf042e63c49 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.204017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816620f3-0f0e-4ae5-b341-cbf042e63c49 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.204298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816620f3-0f0e-4ae5-b341-cbf042e63c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.224000 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-816620f3-0f0e-4ae5-b341-cbf042e63c49 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.229095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-816620f3-0f0e-4ae5-b341-cbf042e63c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.233515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 778/1553] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.234865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971fdf-6146-460f-994f-a3705aa221c5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.235156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971fdf-6146-460f-994f-a3705aa221c5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.235430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971fdf-6146-460f-994f-a3705aa221c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.253008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b0971fdf-6146-460f-994f-a3705aa221c5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.254225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b0971fdf-6146-460f-994f-a3705aa221c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.258635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 776/1554] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:52 2022] PUT /identity/v3/projects/eb7222adc16e4fffa44214043ad0c7ad/users/556f14d079254d7e91fc1e942e2a30a4/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:52.260006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.260293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.260568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.279173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.280446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.314278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 779/1555] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.315552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4f57-794f-4183-ad86-b80c0462ddf9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.315830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4f57-794f-4183-ad86-b80c0462ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.316108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4f57-794f-4183-ad86-b80c0462ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.334012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-393c4f57-794f-4183-ad86-b80c0462ddf9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.335186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-393c4f57-794f-4183-ad86-b80c0462ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.338376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 777/1556] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.338992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.346967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 780/1557] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.348156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae793af-dbe3-4f31-83c4-64a676ed48ca None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.348440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae793af-dbe3-4f31-83c4-64a676ed48ca None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.348713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae793af-dbe3-4f31-83c4-64a676ed48ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.351144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249facc-938e-49c3-9a17-2c1793a37783 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.356061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.356706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.356988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.357255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.357966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.359857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb3983-57d4-49fc-aaf0-db269558dce2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.366166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-1ae793af-dbe3-4f31-83c4-64a676ed48ca None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.367334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1ae793af-dbe3-4f31-83c4-64a676ed48ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.375053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 781/1558] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.376249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6e81-5f59-440c-b5c5-4c19e1153bf5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.376529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6e81-5f59-440c-b5c5-4c19e1153bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.376797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6e81-5f59-440c-b5c5-4c19e1153bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.394497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-797c6e81-5f59-440c-b5c5-4c19e1153bf5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.395673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-797c6e81-5f59-440c-b5c5-4c19e1153bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.404004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 782/1559] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.405149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f70c-a3ca-4757-82f5-7cb45a6d5cc2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.405432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f70c-a3ca-4757-82f5-7cb45a6d5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.405730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f70c-a3ca-4757-82f5-7cb45a6d5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.423152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0576f70c-a3ca-4757-82f5-7cb45a6d5cc2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.424308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0576f70c-a3ca-4757-82f5-7cb45a6d5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.431979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 783/1560] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.433129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.433410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.433695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.450204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.452666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.458540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 784/1561] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.459254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.468878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbe691-31a5-483a-80ca-3c226dcdd8de None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.473272 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.473919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.474196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.474462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.475155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.475453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.477035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.494508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 785/1562] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.494799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 778/1563] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:52.495314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.495407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.495407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.495407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.504149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372188-0d37-4f98-96a7-717c3dd6751e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.511681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.512866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.559424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.560079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.560361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.560647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.561367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.561666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.563299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c031051-87f9-4085-bbe0-0669da14a3bf admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.569199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 779/1564] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.574215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.575074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 786/1565] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.576205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.576499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.576762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.587291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f83d-ecf4-4920-be7c-520ea7ffff23 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.591876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.592521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.592802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.593076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.593853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.594116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.594683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:52.595720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.595836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:52.603619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 787/1566] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:52.604218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.610505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 780/1567] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.611500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.613122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee218c-3fdb-40e1-9dd7-521f4f068c7d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.617554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.618220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.618497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.618771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.619467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.619793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.622025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.633518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 788/1568] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.635066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.645431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba192d-3d95-472a-b253-dea0f08c3140 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.650305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.650985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.651267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.651542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.652216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.654182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.670815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348b816-a015-4793-a8ce-d141c3ddc6fa admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.674421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.675037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.675314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.675581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.684681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.686328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.695386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 781/1569] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:52.696122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.705213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45154a7c-32ce-4d4f-b809-ba1154785568 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.709928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.710540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.710824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.711096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.712011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.713905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.755845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 789/1570] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:52.756946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.766819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636972-4f65-4e44-806f-de253a8a10f0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.771325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.771987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.772266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.772539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.773238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.773537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.775173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.786741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 790/1571] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.787475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.796439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40360ff9-d2b8-498c-825e-285ec25e55b2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.800929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.801521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.801830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.802107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.802795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.804631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.854513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 782/1572] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:52.855567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.911908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 791/1573] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:52.912821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:52.915395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bab3a8-70f7-4b95-982b-c710b5c46a19 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.970430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.971096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.971381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.971843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.972368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:30:52.972672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.974346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.978377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c0c4-d964-4fe0-a720-014325434ace admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:52.983599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:52.994365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:52.994365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:52.994365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:52.994365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:52.994839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 783/1574] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:30:52.994933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:52.995016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.003933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa51c-19c0-4f33-a8a5-b45e5aa9b96f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.008966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.009742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.010140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.010507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.011265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.013179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.100852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 792/1575] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.101717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.129685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 784/1576] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:52 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.130508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.165188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7cf10-43a1-4edb-b611-5943c6d29c67 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.193418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c56a-58a1-44eb-afd9-a3bddb392e1c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.198942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.199610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.199895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.200306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.201004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.202944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.225371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.226391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.226672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.226973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.227863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.229490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.247425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 793/1577] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.247425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.257181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6016-03d2-4a92-a180-2b69fa8cb7d6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.261981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.262676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.263005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.263275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.263955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.265921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.312269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 785/1578] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.313161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.372740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe949d9-35f3-4fbd-a0ba-cd8b5e723124 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.377200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.377869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.378154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.378423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.379095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.381008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.393332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 794/1579] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.393332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.403212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2dbcd-8043-4254-a478-62585b7cabcc admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.408118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.408922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.409200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.409544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.410334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.412394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.477004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 786/1580] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.478483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.489812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b820-70d0-47e7-be8c-380f066acd11 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.494417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.495092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.495648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.495648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.496276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.498288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.540369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 795/1581] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.541245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.597167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 787/1582] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.598104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.603867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32718-d7b0-41a4-a6f7-3ac8b48d0494 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.611164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe81f5-7b22-4977-858f-d1a903514354 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.611302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.611840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.612127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.612409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.613236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.615362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.616029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.616876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.617350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.617533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.618284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.620000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.638281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 788/1583] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.639184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.649434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6fec-9950-4d7e-8261-6f03fdfd036f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.654663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.655295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.655573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.655843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.656507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.658552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.716605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 796/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.717491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.726652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5722a74-0ead-4de3-940a-854db9acdb7f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.731580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.732277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.732557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.732831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.733538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.735275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.749271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 797/1585] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.749271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.750576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 789/1586] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.751455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.759412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a74cf-df8c-43d8-aea6-550b03a2cc25 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.762152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e9a0-9e9e-411b-bfd4-4c26dd8cb5cc admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.764525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.765180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.765463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.765789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.766523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.767033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.767686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.767969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.768134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.768229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.768905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.770892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.779456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 798/1587] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.782667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.789965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8821-5a5f-4aef-bfd5-86bc726f675e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.794465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.795105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.795388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.795663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.796356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.797964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.807544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 799/1588] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.808426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.817792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863808e-e13f-428e-acae-362a5dff5698 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.822888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.824215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.824495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.824767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] PATH_INFO: `/v3/projects/32a30f88009f45e2bf34da32431d651f/users/e2bfb46ce1a040629def5f77869a7aa7/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.838832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a30f88009f45e2bf34da32431d651f, user_id=e2bfb46ce1a040629def5f77869a7aa7, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.841963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:30:53.841963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:30:53.841963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:30:53.844003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.876617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 790/1589] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:53 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:53.877282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.887366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d997-57d6-445b-ab0d-7495ac27a4c9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.891956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.892617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.892894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.893163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.893900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.895501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.910624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 791/1590] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.911782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.922546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797521-bf6e-4427-9698-80e488e3a73a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.927053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.927706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.927986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.928262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.928971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.930613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.940619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 792/1591] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.942599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.952769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c146-3486-4dcf-8324-e502e9f51b2f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:53.957629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:53.958379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:53.958659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:53.958933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:53.959925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:53.961571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:53.977425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 793/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:53.978468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.989622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 800/1593] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:53 2022] PUT /identity/v3/projects/32a30f88009f45e2bf34da32431d651f/users/e2bfb46ce1a040629def5f77869a7aa7/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:53.989622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:53.989965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488e43-8fd9-40ee-9317-43bc62e7f6d1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.048601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.049263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.049549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.049861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.050662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.052270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.062690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 794/1594] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.066879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.069051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e3b4-ea99-43ea-84f1-6644c6322ecd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.075050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.075726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.076006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.076333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.077054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.078160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92624-797c-40be-9d2a-64cd211d4217 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.078929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.082999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.083652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.083934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.084208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.084923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.086865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.093469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 801/1595] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.094532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.106616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 795/1596] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.109640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bd26f-c661-4be3-a33f-251e34de7ea0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.109794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.112518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.113285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.113718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.114030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.114828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.116560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.122974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f89b2-9ff4-4dee-931c-86ddfee1f83e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.127806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.128404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.128706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.128952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.129456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 802/1597] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.130128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.130741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.131818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2bbb5-4482-4f08-9120-5967de9b2ba5 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.143437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80ed7-056c-4bc2-9307-46e70cf59273 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.144529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 796/1598] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.145871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.146160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.146435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.152493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.153475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.153862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.154209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] PATH_INFO: `/v3/projects/662e006a65084501be552aded1b03416/users/2bfbadc0237e44dca0aefa470eddef2f/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.173108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662e006a65084501be552aded1b03416, user_id=2bfbadc0237e44dca0aefa470eddef2f, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.176200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.177470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] MFA Rules not processed for user `e2bfb46ce1a040629def5f77869a7aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:54.179048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:54.248044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 797/1599] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:54.248864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.258901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d5491-b6df-4498-b7dd-6dca2bace765 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.263067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 803/1600] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/662e006a65084501be552aded1b03416/users/2bfbadc0237e44dca0aefa470eddef2f/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:54.263067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.318926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.319825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.320109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.320386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] PATH_INFO: `/v3/projects/cb503745eeb5421c88b2fe9a4ef78921/users/0092d4e191b14af3b1f799271c19fa73/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.326027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f81a-09ff-4d8f-94b5-2f42191a1c33 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.331053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.331970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.332249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.332528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] PATH_INFO: `/v3/projects/0eebba0522ca4ad38c508481bc67b791/users/88623315bbf84017879246b8b97134a6/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.335375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb503745eeb5421c88b2fe9a4ef78921, user_id=0092d4e191b14af3b1f799271c19fa73, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.338458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.347707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eebba0522ca4ad38c508481bc67b791, user_id=88623315bbf84017879246b8b97134a6, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.350468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.493680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 798/1601] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/cb503745eeb5421c88b2fe9a4ef78921/users/0092d4e191b14af3b1f799271c19fa73/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:54.499029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.547131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 804/1602] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/0eebba0522ca4ad38c508481bc67b791/users/88623315bbf84017879246b8b97134a6/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:54.547973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.562200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0c990-336e-42e2-a69a-54a82eff9855 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.613031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30331-89bc-4ec2-beff-260101f4c34d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.617912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.618827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.620957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.620957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] PATH_INFO: `/v3/projects/4867114ee0294491bd5272ab9131a9a0/users/cbeaf23a15bf4c409173d9b314e808bd/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.621943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.622783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.623068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.623340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.624059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.625680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.638008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4867114ee0294491bd5272ab9131a9a0, user_id=cbeaf23a15bf4c409173d9b314e808bd, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.641921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 799/1603] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:54.641921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.642285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.655345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8e86-b81a-4cc7-9a18-e1586329e3b4 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.656878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.657805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.658092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.658368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] PATH_INFO: `/v3/projects/6750a1abb76a492a97a64e85a17b7237/users/d7dc29e12afd4eccb3a311ebaa3061ea/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.673478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6750a1abb76a492a97a64e85a17b7237, user_id=d7dc29e12afd4eccb3a311ebaa3061ea, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.676455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd355-69a9-49dd-8d17-c9cbe38d1e1c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.723873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 805/1604] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/4867114ee0294491bd5272ab9131a9a0/users/cbeaf23a15bf4c409173d9b314e808bd/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:54.725139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.764497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 800/1605] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/6750a1abb76a492a97a64e85a17b7237/users/d7dc29e12afd4eccb3a311ebaa3061ea/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:54.767113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7a2f-89fd-4a97-acba-0c95e81d7236 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.767413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7a2f-89fd-4a97-acba-0c95e81d7236 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.767685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7a2f-89fd-4a97-acba-0c95e81d7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.802688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-93fb7a2f-89fd-4a97-acba-0c95e81d7236 None None] MFA Rules not processed for user `2bfbadc0237e44dca0aefa470eddef2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:54.804478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-93fb7a2f-89fd-4a97-acba-0c95e81d7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:54.830009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7109e86-e59c-4893-8324-380683310168 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:54.892258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 801/1606] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:54.892258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ed58-294f-4ada-9211-23990c415a18 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.892258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ed58-294f-4ada-9211-23990c415a18 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.892258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ed58-294f-4ada-9211-23990c415a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.903682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:54.906368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.906666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.906952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.907820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:54.910579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5281568-b1cf-435e-bf5f-a4f9bcca97cf admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:54.914580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3b54ed58-294f-4ada-9211-23990c415a18 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:54.915795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3b54ed58-294f-4ada-9211-23990c415a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:54.924853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 802/1607] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:54.925850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:54.926126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:54.926403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:54.959705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:54.962626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:54.975960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 803/1608] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:54.976721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:54.993300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43bec-03a7-45c5-9d5f-37c1a3b4c2b9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.007009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.007945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.008419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.008789 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] PATH_INFO: `/v3/projects/ddc585c03c5446ce92392af40d47fef1/users/b9c16061c6804b44973a6b54158ed6e0/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.038011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc585c03c5446ce92392af40d47fef1, user_id=b9c16061c6804b44973a6b54158ed6e0, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.040805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944103f-1760-466a-88d2-f79f365ef5b7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.072372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 806/1609] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:54 2022] POST /identity/v3/projects => generated 365 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:55.074288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.074701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.074867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.088054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 804/1610] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:54 2022] PUT /identity/v3/projects/ddc585c03c5446ce92392af40d47fef1/users/b9c16061c6804b44973a6b54158ed6e0/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:55.090155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.090572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.090979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.109114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:55.109246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] MFA Rules not processed for user `cbeaf23a15bf4c409173d9b314e808bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:55.110548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.111836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.174196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 805/1611] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:55.175334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.185730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7cf56-d559-4df0-b977-51f92c8ddd98 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.191167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.191842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.192127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.192407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.193101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.194192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 807/1612] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:55.195135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.195275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.196815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.271115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeaf87-1d6e-4e29-97ff-e1f5aaaff229 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.275240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.275829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.276110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.277107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.278468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 806/1613] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:55.279213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.288717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.290293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.300263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 808/1614] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:55.301025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.310997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69727d-dd96-4a9d-98a1-34b3d9ccdcb6 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.339584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbb693-3010-4108-9f81-4eb214f073cb admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.344294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.345301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.345656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.346025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.374678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.375458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.375861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.376210 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.376966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.379001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.419981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.422287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba376663-f341-45b9-8289-745e53a81428 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.433310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 807/1615] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:55.435012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe87600-02f0-4f67-ab91-11e5ddde757f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.435348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe87600-02f0-4f67-ab91-11e5ddde757f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.435629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe87600-02f0-4f67-ab91-11e5ddde757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.471089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8fe87600-02f0-4f67-ab91-11e5ddde757f None None] MFA Rules not processed for user `b9c16061c6804b44973a6b54158ed6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:55.472907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8fe87600-02f0-4f67-ab91-11e5ddde757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.534002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 809/1616] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:55.534002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.544971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c72813-6559-41f9-882e-7e1ba7aefb6e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.548905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.549757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.550067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.550421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.562572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 808/1617] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:55.564749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366787-3713-4cde-ae4a-df3a1bde7231 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.565256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366787-3713-4cde-ae4a-df3a1bde7231 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.565741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366787-3713-4cde-ae4a-df3a1bde7231 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.568281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.569840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.578793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 809/1618] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:30:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:30:55.579634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366787-3713-4cde-ae4a-df3a1bde7231 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.582675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 810/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:55.583752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.595560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1b12f-f823-459b-a541-4b0d7951752d service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.596979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366787-3713-4cde-ae4a-df3a1bde7231 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.601539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.602200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.602341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.602579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.602856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.602999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.603362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.603527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.603634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.604226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.605246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f55726-957b-434e-b1df-8148fd2a29c2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.606276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79b34-1db5-4878-8eb0-5e7252ce1811 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.619204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 811/1620] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:55.621874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573644-2241-47bc-988d-ea32c0314c71 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.622168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573644-2241-47bc-988d-ea32c0314c71 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.622441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59573644-2241-47bc-988d-ea32c0314c71 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.624510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 812/1621] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:30:55.625724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.626073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.626288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.649012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:55.650284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.722132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 813/1622] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:55.722924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.733848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92683c67-394e-4d39-b3bb-5c9bfeb47a15 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.739610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.740593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.740945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.741298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] PATH_INFO: `/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd/users/559aaadbac3041598941ac0ce6a88229/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.752689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 810/1623] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:30:55.755411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.755411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.755411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.759962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fcf55a5c0343feb3c36cf1167238fd, user_id=559aaadbac3041598941ac0ce6a88229, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.762985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.794300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:55.796613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:55.811649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 811/1624] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:55.813097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.828319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e9e66-b55f-4822-af4f-2ba61e0ac156 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:55.840959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:55.841890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:55.842712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:55.843250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:55.908917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 814/1625] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:55 2022] PUT /identity/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd/users/559aaadbac3041598941ac0ce6a88229/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:55.910124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.954281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:55.956605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:55.967908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 812/1626] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:55.969233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:55.989245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b839b62-2f9e-4f60-90a2-1a589c82ff38 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.077587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a885a-9144-4bb2-a26f-fecc51249aa6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.090459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.091396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.091683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.091960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.092685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.094349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.122554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 815/1627] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:56.123468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.124354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.125101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.125458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.125964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.144138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82092a73-96a7-4661-b1ff-b31708a44571 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.155789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.156548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.156788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.157062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.157858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.161527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.193411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 816/1628] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:56.194908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.248669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbeed-a653-412d-bf3b-d992244a30e7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.262011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.264177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.264483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.266590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] PATH_INFO: `/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f/users/757f13e50ba64cf7b5490f3d08a89e1e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.303070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a5c0f7c47c48389d0f5888e0dfa93f, user_id=757f13e50ba64cf7b5490f3d08a89e1e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.306733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.310281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.312512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.345863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 813/1629] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:56.347594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.393447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b041c-8b14-434d-8f43-3af17f43f668 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.408391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.409313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.409596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.409904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] PATH_INFO: `/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd/users/559aaadbac3041598941ac0ce6a88229/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.419419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fcf55a5c0343feb3c36cf1167238fd, user_id=559aaadbac3041598941ac0ce6a88229, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.425211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 817/1630] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:56 2022] PUT /identity/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f/users/757f13e50ba64cf7b5490f3d08a89e1e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:56.426542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.427477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86872-efde-4d54-842b-8f75d93a3791 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.462746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 814/1631] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:56 2022] PUT /identity/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd/users/559aaadbac3041598941ac0ce6a88229/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:56.473494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418da85-e800-41e8-af3d-c55c034c3b38 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.473694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418da85-e800-41e8-af3d-c55c034c3b38 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.474242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418da85-e800-41e8-af3d-c55c034c3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.556760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5418da85-e800-41e8-af3d-c55c034c3b38 None None] MFA Rules not processed for user `559aaadbac3041598941ac0ce6a88229`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:56.559917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5418da85-e800-41e8-af3d-c55c034c3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:56.625529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e42835-7bd3-46f3-9250-adf2bed91ee0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.761287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.762292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.762679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.763054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.763892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.765752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.766805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 815/1632] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:56.768286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1d27-0ccd-49ac-9907-58f5aa4d7386 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.768580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1d27-0ccd-49ac-9907-58f5aa4d7386 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.768859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1d27-0ccd-49ac-9907-58f5aa4d7386 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.773623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 816/1633] 10.222.0.24 () {54 vars in 912 bytes} [Fri Mar 25 03:30:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:30:56.780000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccd5f-c3bd-4a2d-8bd3-83e6e6a7e34f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.782115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccd5f-c3bd-4a2d-8bd3-83e6e6a7e34f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.782115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffccd5f-c3bd-4a2d-8bd3-83e6e6a7e34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.798031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 818/1634] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:30:56.798031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.827305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8ffccd5f-c3bd-4a2d-8bd3-83e6e6a7e34f None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:56.828843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8ffccd5f-c3bd-4a2d-8bd3-83e6e6a7e34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:56.858451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4e23-0eba-4958-bf42-9bfb074fa370 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.862749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.863612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.863997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.864344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.892300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.893901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.907956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 819/1635] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:56.915162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:56.920436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c94b0-181d-495c-99d7-34c8dcd10e2f service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:56.926385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:56.927357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.927824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.928069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] PATH_INFO: `/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f/users/757f13e50ba64cf7b5490f3d08a89e1e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.930136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a5c0f7c47c48389d0f5888e0dfa93f, user_id=757f13e50ba64cf7b5490f3d08a89e1e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:56.933816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c551-99f9-48e0-a161-51f4a7c0d056 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:56.965503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 820/1636] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:30:56 2022] PUT /identity/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f/users/757f13e50ba64cf7b5490f3d08a89e1e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:30:56.967481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1f7a-5a68-408e-8275-b02fb1f0d272 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.967779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1f7a-5a68-408e-8275-b02fb1f0d272 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.968058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1f7a-5a68-408e-8275-b02fb1f0d272 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.982888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 821/1637] 10.222.0.24 () {54 vars in 912 bytes} [Fri Mar 25 03:30:56 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:30:56.984572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 817/1638] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:30:56.987593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.988158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.988829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:56.990562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:56.990859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:56.991138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:57.030606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:57.032663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:57.055549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] MFA Rules not processed for user `757f13e50ba64cf7b5490f3d08a89e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:57.059787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:57.179598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 822/1639] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:57.190271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:57.231948 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 818/1640] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:57.234127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:57.321626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feeb56-7f15-47dc-a6a6-ca59999d8638 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:57.322995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c055b75-bf51-4358-9890-cc0665522828 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:57.329759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:57.330862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:57.331368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:57.331852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:57.335145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:57.335630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:57.335915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:57.336446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:57.354289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:57.357976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:57.367023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:57.369322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:57.395464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 823/1642] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:57.414382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 819/1642] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:57.494257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:57.508482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf49c-8ca7-4f34-87ac-135e3d0b2f23 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:57.521182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:57.521282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:57.521282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:57.521282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:57.522931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:57.531959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86dc6d-d532-403b-a717-65084a71ca07 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:57.536859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:57.542305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:57.542924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:57.543284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:57.556914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:57.559519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e3d5-f4a6-40d2-b134-c4fa2001ee0c service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:57.592849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 820/1643] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:57.641588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:57.643280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a3de9-797d-4866-bac9-4b7ad4b9d0f4 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:57.657214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 824/1644] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:58.540139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:58.540675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:58.540675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:58.604957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] MFA Rules not processed for user `88623315bbf84017879246b8b97134a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:58.607196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:58.710751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 821/1645] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:58.725896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e921c-f052-4e55-b20b-3a357cf2955d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:58.725896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e921c-f052-4e55-b20b-3a357cf2955d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:58.725896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e921c-f052-4e55-b20b-3a357cf2955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:58.747505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-135e921c-f052-4e55-b20b-3a357cf2955d None None] MFA Rules not processed for user `88623315bbf84017879246b8b97134a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:30:58.751134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-135e921c-f052-4e55-b20b-3a357cf2955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:30:58.761107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 825/1646] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:30:59.160380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:30:59.181217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360655-9657-4adb-b86d-535c3d72f19e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:30:59.193913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:30:59.194574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:59.194862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:59.195141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:59.233704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:30:59.246515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:30:59.279906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 822/1647] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:30:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:30:59.940004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:30:59.940609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:30:59.940781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:30:59.999048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] MFA Rules not processed for user `556f14d079254d7e91fc1e942e2a30a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:00.000707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:00.107129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.193780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 826/1648] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:00.234507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.265033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08150b44-fe20-4f81-94d6-0605fd2cd501 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:00.273746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:00.274390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.274683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.274981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.284593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:00.286300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3129eb-fcf1-463d-9bdc-d834bd339ec0 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:00.291598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41d5af-6f61-431c-b1c4-e8bcf45a9fa5 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:00.297290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 827/1649] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:00.298909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ba97-ed7d-4250-90f8-50ee5806f606 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.299411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ba97-ed7d-4250-90f8-50ee5806f606 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.299868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ba97-ed7d-4250-90f8-50ee5806f606 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.303014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 828/1650] 10.222.0.24 () {54 vars in 912 bytes} [Fri Mar 25 03:31:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:31:00.304153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:00.305036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.305317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.305589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] PATH_INFO: `/v3/users/cbeaf23a15bf4c409173d9b314e808bd` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.306805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbeaf23a15bf4c409173d9b314e808bd)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:00.308868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.309155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.309434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.312419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:00.394935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:00.399487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:00.518271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbeaf23a15bf4c409173d9b314e808bd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:00.531955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbeaf23a15bf4c409173d9b314e808bd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:00.536377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 829/1651] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:00.562314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.594557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565f2f-4be4-4cda-8ffb-6ed4f1c5eb47 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:00.600211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757f13e50ba64cf7b5490f3d08a89e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a5c0f7c47c48389d0f5888e0dfa93f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:00.601132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.601522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.601930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.602913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:00.603488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:00.605986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:00.631073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 830/1652] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:00.632273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.641560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbeaf23a15bf4c409173d9b314e808bd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:00.659815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ce172-bc31-45a4-a6f7-ad668e030595 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:00.665451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757f13e50ba64cf7b5490f3d08a89e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a5c0f7c47c48389d0f5888e0dfa93f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:00.666216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.666522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.666650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbeaf23a15bf4c409173d9b314e808bd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:00.666900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.667372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a170c85-9691-4975-9015-eff6fd3e9125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbeaf23a15bf4c409173d9b314e808bd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:00.667943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:00.671076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:00.680631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 823/1653] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:00 2022] DELETE /identity/v3/users/cbeaf23a15bf4c409173d9b314e808bd => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:00.690633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.690964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.691188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.732623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:00.734092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:00.787892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 831/1654] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:00 2022] POST /identity/v3/projects => generated 354 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:00.798343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.814360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:00.887085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 824/1655] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:00.891613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:00.893046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:00.967048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84613d-f420-4c85-b544-34bf4fa02dc6 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:00.983065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757f13e50ba64cf7b5490f3d08a89e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a5c0f7c47c48389d0f5888e0dfa93f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:00.984396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:00.984683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:00.984966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:00.986041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:00.986376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:00.988214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:01.007415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 832/1656] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:01.008370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:01.011243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:01.033232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703961-f938-4dce-a7fd-627972dd8917 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:01.115593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:01.116285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:01.116520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:01.116975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:01.120727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eea1e-4f3f-4931-923f-e2f79bff6358 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:01.125083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:01.126658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:01.127525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:01.128660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:01.135577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:01.150094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:01.151696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:01.161265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 833/1657] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:01.162695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:01.174884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b19db-66ee-4d4d-afbe-205900c643e8 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:01.190566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757f13e50ba64cf7b5490f3d08a89e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a5c0f7c47c48389d0f5888e0dfa93f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:01.191456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:01.191743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:01.192019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] PATH_INFO: `/v3/projects/ce27c93f8ce7412d8d94a602db6f2000` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:01.193232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce27c93f8ce7412d8d94a602db6f2000)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:01.195298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:01.446244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:01.446244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905055a7-82e9-4d06-8037-1e29622daa90 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:01.446244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 825/1658] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:01.448320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce27c93f8ce7412d8d94a602db6f2000', 'request_id': 'req-bbe30dc2-aec0-436a-b528-93057d867485'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:01.448320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce27c93f8ce7412d8d94a602db6f2000', 'request_id': 'req-bbe30dc2-aec0-436a-b528-93057d867485'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:01.448320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce27c93f8ce7412d8d94a602db6f2000', 'request_id': 'req-bbe30dc2-aec0-436a-b528-93057d867485'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:01.500269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] The token cache is being invalidate because project ce27c93f8ce7412d8d94a602db6f2000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:01.500269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:01.500269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bbe30dc2-aec0-436a-b528-93057d867485 tempest-VolumeQuotaClassesTest-498786373 tempest-VolumeQuotaClassesTest-498786373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:01.500269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 834/1659] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:01 2022] DELETE /identity/v3/projects/ce27c93f8ce7412d8d94a602db6f2000 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:02.315460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:02.315875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:02.316073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:02.318159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 826/1660] 10.222.0.24 () {54 vars in 960 bytes} [Fri Mar 25 03:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:31:02.324662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:02.325171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:02.325263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:02.335964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:02.338897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:02.358734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] MFA Rules not processed for user `47e9285da9a24b19afb6038cd95122a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:02.359974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:02.575916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbca5df-3cfa-4f08-8c6b-620e2fd5cc74 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:02.586021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:02.587397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:02.587848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:02.588290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] PATH_INFO: `/v3/users/2bfbadc0237e44dca0aefa470eddef2f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:02.589747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfbadc0237e44dca0aefa470eddef2f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:02.591854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:02.633887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 835/1661] 10.222.0.24 () {58 vars in 1057 bytes} [Fri Mar 25 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:02.634873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:02.638624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:02.664253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743fac0-a56f-4904-90ba-85fc5dfbf2af None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:02.670017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:02.689428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:02.689428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:02.689428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] PATH_INFO: `/v3/projects/4867114ee0294491bd5272ab9131a9a0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:02.689428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4867114ee0294491bd5272ab9131a9a0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:02.689428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:02.988638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4867114ee0294491bd5272ab9131a9a0', 'request_id': 'req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:02.991969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfbadc0237e44dca0aefa470eddef2f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:02.994028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4867114ee0294491bd5272ab9131a9a0', 'request_id': 'req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.001135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4867114ee0294491bd5272ab9131a9a0', 'request_id': 'req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.005636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfbadc0237e44dca0aefa470eddef2f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.213688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] The token cache is being invalidate because project 4867114ee0294491bd5272ab9131a9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:03.214040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.215478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.220321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 836/1662] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:02 2022] DELETE /identity/v3/projects/4867114ee0294491bd5272ab9131a9a0 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:03.220321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:03.220321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.282637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfbadc0237e44dca0aefa470eddef2f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.319235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfbadc0237e44dca0aefa470eddef2f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.320854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfbadc0237e44dca0aefa470eddef2f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.341071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b96d-23a2-47eb-b4c2-8c2707ba8939 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:03.348871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 827/1663] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:02 2022] DELETE /identity/v3/users/2bfbadc0237e44dca0aefa470eddef2f => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:03.349965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:03.352080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.445939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4666b-3601-4c26-8df0-ea62f273d8a2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:03.483666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:03.484476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.484970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.485519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.488175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.495701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:03.499448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.499857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.500235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] PATH_INFO: `/v3/users/b9c16061c6804b44973a6b54158ed6e0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.504718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c16061c6804b44973a6b54158ed6e0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:03.506063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:03.507659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:03.507978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62621ce-7a7e-48e2-8cc8-b37a3cc015d1 service placement] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:03.544248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 837/1664] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:03.548157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269370b-36b9-429a-a2e4-c8211abdc0cb None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.548634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269370b-36b9-429a-a2e4-c8211abdc0cb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.549500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269370b-36b9-429a-a2e4-c8211abdc0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.596960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9269370b-36b9-429a-a2e4-c8211abdc0cb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:03.601241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9269370b-36b9-429a-a2e4-c8211abdc0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.624033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 838/1665] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:03.637537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ebf8-da71-439c-ab67-3573a73d2691 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.637837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ebf8-da71-439c-ab67-3573a73d2691 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.638298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ebf8-da71-439c-ab67-3573a73d2691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.684162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3806ebf8-da71-439c-ab67-3573a73d2691 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:03.688378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3806ebf8-da71-439c-ab67-3573a73d2691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.710992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 839/1666] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:03.716706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.717334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.717908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.763067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:03.767149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c16061c6804b44973a6b54158ed6e0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.768611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.786085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c16061c6804b44973a6b54158ed6e0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.792295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 840/1667] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:03.793783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:03.795566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.870850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c16061c6804b44973a6b54158ed6e0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.890740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c16061c6804b44973a6b54158ed6e0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.893301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c16061c6804b44973a6b54158ed6e0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:03.897966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84535191-20e8-4c0f-af93-cc6097ac1074 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:03.905307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:03.907526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.908576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.908686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 828/1668] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:03 2022] DELETE /identity/v3/users/b9c16061c6804b44973a6b54158ed6e0 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:03.909063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:03.913676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.916387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:03.920137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:03.946117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:03.947915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446cbd-6ede-4626-b21e-63b8150153e9 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:03.991616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 841/1669] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:03.995245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:03.995614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:03.997747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.037312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:04.038410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:04.084163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebff83-c06f-47bf-8834-1b6995590d0a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.104186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.106145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.106613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.108558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.109564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:04.109919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.114404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.145725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 829/1670] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:04.147234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.184645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 842/1671] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:04.189115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2566b-cbc2-445d-b79b-abb5634d5671 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.206364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.208094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:04.208801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.212603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.215587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.216787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.230154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.235651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.331839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 830/1672] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:04 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:04.337186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.348385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278dd72-4834-4b06-9419-a68fe98a7631 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.412140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.413630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.414116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.414680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.490777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.492395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.504541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 843/1673] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:04.517679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bbe2-c1d8-45cb-884d-966ddd1409ef admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.534442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.535285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.535575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.535848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.536682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.538794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.671689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 831/1674] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:04 2022] POST /identity/v3/users => generated 303 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:04.675699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.688516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f311b-8e31-44d7-934f-9f3f8a14e79a service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.705437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.706153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.714775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.716703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.717832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.724114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.762433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 844/1675] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:04.766603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.780466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38d96-06fe-47b0-b6e2-686cc1cc04c0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.793412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.794214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.794567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.794915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.795715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.797400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b13fa-0138-4bdd-944b-d7385bb08009 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.821724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 832/1676] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:04.826459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:04.837911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0725ed-45cd-4909-8c7b-9d2e802a24bd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:04.854678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:04.855698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.856103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.856458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] PATH_INFO: `/v3/projects/2bd2692bee354697971c77a5a0c90f98/users/49bd8b71152a4b4fbb1e120e84e7fa67/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:04.893896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd2692bee354697971c77a5a0c90f98, user_id=49bd8b71152a4b4fbb1e120e84e7fa67, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:04.897033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:04.974033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 845/1677] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:04 2022] PUT /identity/v3/projects/2bd2692bee354697971c77a5a0c90f98/users/49bd8b71152a4b4fbb1e120e84e7fa67/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:04.986963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:04.987694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:04.988338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:05.074436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] MFA Rules not processed for user `49bd8b71152a4b4fbb1e120e84e7fa67`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:05.075880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:05.229882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 833/1678] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:05.234295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:05.543583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf18978-60ef-4c9d-9b77-9e5355e6ef60 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:05.552477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:05.553396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:05.553855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:05.554270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:05.555102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:05.559710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:05.709186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 846/1679] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:05 2022] POST /identity/v3/projects => generated 403 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:05.713417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:05.722328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:05.724559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:05.728811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437895e-d666-42e9-bf85-65dac9020192 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:05.864833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:05.865900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:05.866780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:05.866780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:05.872073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:05.872073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:05.884151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3aa22-833b-429e-92c6-a371af3bbed8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:05.892745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:05.893615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:05.893951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:05.894869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] PATH_INFO: `/v3/projects/662e006a65084501be552aded1b03416` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:05.895436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662e006a65084501be552aded1b03416)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:05.897539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:05.999381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 834/1680] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:05 2022] POST /identity/v3/users => generated 308 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:06.001059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:06.032280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662e006a65084501be552aded1b03416', 'request_id': 'req-581aa73a-678f-4329-8ce8-38987305b7a2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.036337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c68f4-a04f-408a-847b-82a300135247 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:06.050098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662e006a65084501be552aded1b03416', 'request_id': 'req-581aa73a-678f-4329-8ce8-38987305b7a2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.073056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662e006a65084501be552aded1b03416', 'request_id': 'req-581aa73a-678f-4329-8ce8-38987305b7a2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.161932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] The token cache is being invalidate because project 662e006a65084501be552aded1b03416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:06.162224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.163678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.171050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 847/1681] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:05 2022] DELETE /identity/v3/projects/662e006a65084501be552aded1b03416 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:06.171994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:06.175514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:06.284218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:06.284899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:06.292106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:06.293645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:06.301228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:06.303581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:06.348782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 835/1682] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:06.351900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:06.356420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:06.382154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262349-a894-4b53-9dc2-9dee10dd1943 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:06.405498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:06.406669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:06.406791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa73a-678f-4329-8ce8-38987305b7a2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:06.406949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:06.407839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] PATH_INFO: `/v3/users/757f13e50ba64cf7b5490f3d08a89e1e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:06.409478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757f13e50ba64cf7b5490f3d08a89e1e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:06.415716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:06.416327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:06.417257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:06.421128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:06.421472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] PATH_INFO: `/v3/projects/ddc585c03c5446ce92392af40d47fef1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:06.424938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc585c03c5446ce92392af40d47fef1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:06.428506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:06.710838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757f13e50ba64cf7b5490f3d08a89e1e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.712115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc585c03c5446ce92392af40d47fef1', 'request_id': 'req-799b55d1-af55-46f2-96f9-f0eaca3ade5f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.719826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc585c03c5446ce92392af40d47fef1', 'request_id': 'req-799b55d1-af55-46f2-96f9-f0eaca3ade5f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.727012 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757f13e50ba64cf7b5490f3d08a89e1e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.742131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc585c03c5446ce92392af40d47fef1', 'request_id': 'req-799b55d1-af55-46f2-96f9-f0eaca3ade5f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.837208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757f13e50ba64cf7b5490f3d08a89e1e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.852729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757f13e50ba64cf7b5490f3d08a89e1e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.853834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757f13e50ba64cf7b5490f3d08a89e1e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.882216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 836/1683] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:06 2022] DELETE /identity/v3/users/757f13e50ba64cf7b5490f3d08a89e1e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:06.887431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:06.893108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:06.895974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] The token cache is being invalidate because project ddc585c03c5446ce92392af40d47fef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:06.896596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.897559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-799b55d1-af55-46f2-96f9-f0eaca3ade5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:06.903800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 848/1684] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:06 2022] DELETE /identity/v3/projects/ddc585c03c5446ce92392af40d47fef1 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:06.903800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143481-8e5c-4f09-abb4-26a9c6691767 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:06.903800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143481-8e5c-4f09-abb4-26a9c6691767 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:06.903800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143481-8e5c-4f09-abb4-26a9c6691767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:06.930332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ac143481-8e5c-4f09-abb4-26a9c6691767 None None] MFA Rules not processed for user `556f14d079254d7e91fc1e942e2a30a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:06.932757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ac143481-8e5c-4f09-abb4-26a9c6691767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:07.058489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 849/1685] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:07.060267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5bcfe-765a-4398-8824-8efb0c9b2ae2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.063747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5bcfe-765a-4398-8824-8efb0c9b2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.064136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5bcfe-765a-4398-8824-8efb0c9b2ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.083586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3d9b-1329-4735-b594-0ced8720c166 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:07.094791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-85f5bcfe-765a-4398-8824-8efb0c9b2ae2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:07.096590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:07.098256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.098497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.100247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] PATH_INFO: `/v3/projects/9dab1c36d8b5424f97428324fb9ca32c/users/7f057836299e4fc49c55dfb457c5257a/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.107028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-85f5bcfe-765a-4398-8824-8efb0c9b2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:07.121510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 850/1686] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:07.131251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.133274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.134573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.151448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dab1c36d8b5424f97428324fb9ca32c, user_id=7f057836299e4fc49c55dfb457c5257a, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:07.169121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:07.246702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:07.248103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:07.271335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 837/1687] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:06 2022] PUT /identity/v3/projects/9dab1c36d8b5424f97428324fb9ca32c/users/7f057836299e4fc49c55dfb457c5257a/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:07.275321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:07.282790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:07.296582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 851/1688] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:07.307875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:07.328478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914d8a-84b3-4c39-b496-653bf67db261 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:07.469385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:07.474528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.475489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.476543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.478081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:07.478827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:07.482909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:07.526050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 852/1689] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:07.532566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:07.545030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3edc4-4720-43af-8d0d-c7cded58883c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:07.559620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be1be-0c2f-4296-8cf9-5f810fbf3afb admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:07.568604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:07.569286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.569568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.573133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.573884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:07.575632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:07.576768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.577248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.577768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.578660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:07.581052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:07.586516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:07.628214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 838/1690] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:07.643467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:07.666848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd222-1244-4500-a2e1-295f9b55516b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:07.670254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:07.671168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.671448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.671722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] PATH_INFO: `/v3/projects/9dab1c36d8b5424f97428324fb9ca32c/users/7f057836299e4fc49c55dfb457c5257a/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.674709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dab1c36d8b5424f97428324fb9ca32c, user_id=7f057836299e4fc49c55dfb457c5257a, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:07.677568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acdb0b-802e-46dc-9f0c-612891f25df0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:07.697708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 853/1691] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:07 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:07.702388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:07.736198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 839/1692] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:07 2022] PUT /identity/v3/projects/9dab1c36d8b5424f97428324fb9ca32c/users/7f057836299e4fc49c55dfb457c5257a/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:07.747495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:07.747792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:07.748068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:07.862553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] MFA Rules not processed for user `7f057836299e4fc49c55dfb457c5257a`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:07.864059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:07.928442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929c4-7125-495e-bd2a-b739ddf47dd9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.036150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 840/1693] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:08.048705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.050297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:08.110420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.111106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.111394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.111858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.112993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.115097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.195559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a9476-17e9-4370-b687-71b876d7f421 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.205711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 854/1694] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:07 2022] POST /identity/v3/users => generated 284 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:08.208381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.208667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.214155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.214443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.214718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.225927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae91cf1-7a5a-415c-a842-55b1efc3cdc8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.238353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.239231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.239576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.239881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.240798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.242905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8685-356e-49e3-9189-ad6c48f4a44d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.248679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.250213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.276652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 841/1695] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:08.276904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 855/1696] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:08.277737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.279171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.282492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:08.282599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.282599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.300327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4192-0272-4379-94f6-372ccb091716 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.302602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:08.304191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:08.313044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.314158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.314454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.314755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] PATH_INFO: `/v3/users/e2bfb46ce1a040629def5f77869a7aa7` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.317711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bfb46ce1a040629def5f77869a7aa7)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.319704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.425345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 856/1697] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:08.426408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.444975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f870f8-deb6-4d99-bbe5-30da4d3d1ab1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.450595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.451740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.452025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.452294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.454216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.454904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.466955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 857/1698] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:08.471541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.485159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd5ab5-c37e-4d39-9ec9-d4623b4f1094 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.491047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.492073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.492439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.492777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] PATH_INFO: `/v3/projects/75e3d33b344e4282898b0765a1501874/users/90904db570144c96b79b98f1748555e3/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.526953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e3d33b344e4282898b0765a1501874, user_id=90904db570144c96b79b98f1748555e3, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.533154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:08.658293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bfb46ce1a040629def5f77869a7aa7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:08.670403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bfb46ce1a040629def5f77869a7aa7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:08.688708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 858/1699] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:08 2022] PUT /identity/v3/projects/75e3d33b344e4282898b0765a1501874/users/90904db570144c96b79b98f1748555e3/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:08.689926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:08.796560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bfb46ce1a040629def5f77869a7aa7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:08.827758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bfb46ce1a040629def5f77869a7aa7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:08.829722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a09acb15-7ba8-44fc-b9ea-5ae22f61da91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bfb46ce1a040629def5f77869a7aa7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:08.835649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225ea0-fcca-4c93-a250-d3b6a9df5000 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:08.838860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 842/1700] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:08 2022] DELETE /identity/v3/users/e2bfb46ce1a040629def5f77869a7aa7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:08.845328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244942c-f45e-4a30-a11a-157f2fedfb0b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.845838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244942c-f45e-4a30-a11a-157f2fedfb0b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.846297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244942c-f45e-4a30-a11a-157f2fedfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.893834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0244942c-f45e-4a30-a11a-157f2fedfb0b None None] MFA Rules not processed for user `90904db570144c96b79b98f1748555e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:08.899946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0244942c-f45e-4a30-a11a-157f2fedfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:08.970846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:08.973809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:08.973809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:08.973809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] PATH_INFO: `/v3/users/49bd8b71152a4b4fbb1e120e84e7fa67` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:08.976988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bd8b71152a4b4fbb1e120e84e7fa67)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:08.978124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: WARNING py.warnings [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:31:08.978124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: warnings.warn(msg) Mar 25 03:31:08.978124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: Mar 25 03:31:08.979949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:09.014602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 843/1701] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:09.027502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.027977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.028405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.059480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:09.061187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.075026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 844/1702] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:09.076278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:09.078116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.177874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0603b5-5f88-42a0-9bae-d73f15bf6a54 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:09.185600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:09.186455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.186790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.187069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.190757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.222820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bd8b71152a4b4fbb1e120e84e7fa67'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:09.257725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bd8b71152a4b4fbb1e120e84e7fa67'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:09.294328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bd8b71152a4b4fbb1e120e84e7fa67'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:09.295573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bd8b71152a4b4fbb1e120e84e7fa67'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:09.309572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:09.312221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:09.325261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 845/1703] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:31:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:31:09.326509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:09.328838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.370520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bd8b71152a4b4fbb1e120e84e7fa67'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:09.381128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 859/1704] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:08 2022] DELETE /identity/v3/users/49bd8b71152a4b4fbb1e120e84e7fa67 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:09.383139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:09.389466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.483701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89da9-c01c-44a4-8fe0-69a2cc376dca service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:09.571529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d38a-5300-4241-8220-1c8a349fbb0b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:09.583275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:09.584234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.584905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.585326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.591547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.652929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:09.653491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.653804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.654085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.665553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.774580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:09.776306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d2c8-e5e8-46b7-885d-d64c9054a7ed service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:09.797398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 860/1705] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:09.800068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.800383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.800635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.823566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:09.825069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b868760-18e6-4b3a-8bca-a7fd112561d4 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:09.843573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:09.844948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.852755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 846/1706] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:09.855340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.855624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.855900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.868305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 861/1707] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:09.868305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:09.869901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.892232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:09.893524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.896829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e02c2-6745-4668-af4d-7c2cd3eb86d0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:09.906501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:09.907383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.907745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.907934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] PATH_INFO: `/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.911821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 847/1708] 10.222.0.35 () {58 vars in 1015 bytes} [Fri Mar 25 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:09.912705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:09.913186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a5c0f7c47c48389d0f5888e0dfa93f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:09.915305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:09.918735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:09.937585 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99180-dc3d-4263-917f-c3e2b03e36bf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:09.953187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:09.953995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:09.954292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:09.954625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:09.990878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:09.992573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:10.032021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 848/1709] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:10.032905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:10.073245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2c5-cc51-40d7-9d4c-8042eaad44ca service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:10.103128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a5c0f7c47c48389d0f5888e0dfa93f', 'request_id': 'req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:10.120777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a5c0f7c47c48389d0f5888e0dfa93f', 'request_id': 'req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:10.156537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a5c0f7c47c48389d0f5888e0dfa93f', 'request_id': 'req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:10.265964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:10.273056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] The token cache is being invalidate because project 47a5c0f7c47c48389d0f5888e0dfa93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:10.273356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:10.274338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c66486b9-0c28-40fc-b315-c3ddd1e64d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:10.280044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 862/1710] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:09 2022] DELETE /identity/v3/projects/47a5c0f7c47c48389d0f5888e0dfa93f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:10.285141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:10.285433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:10.289146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:10.289262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:10.289262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:10.289262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:10.316216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:10.380088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:10.394257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:10.394408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:10.410488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470b8b9-0ef9-427c-b2a4-afdc46da8092 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:10.458085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 849/1711] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:10.681750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 863/1712] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:10.690785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:10.691532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:10.691856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:10.733057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:10.734405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:10.755664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 850/1713] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:10.759582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:10.771430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55cdf2-5854-4185-b6c0-97f3a0469c4a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:10.794670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:10.795922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:10.796205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:10.796482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:10.797269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:10.797575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:10.799348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:10.899926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 864/1714] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:10.914686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:10.933688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6399e17-d476-4bc7-b62d-738164d37d06 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:10.941527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:10.953290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:10.953290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:10.953290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:10.953290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:10.953290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:11.252195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 851/1715] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:11.256248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:11.289028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131691-69e1-46f4-a0b3-058c307dd045 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:11.441406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:11.446595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:11.448676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:11.450158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:11.455315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:11.461523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:11.566625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 865/1716] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:11 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:11.567934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:11.588545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e82322-38e2-4c31-b06e-c819fda46bde admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:11.600481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:11.616334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:11.618461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:11.618956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:11.623836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:11.627038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:11.655799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 852/1717] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:11.668311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:11.686977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e420-7780-40e7-82ac-92cb5b7de990 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:11.696177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:11.697146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:11.697358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:11.698443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:11.699228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:11.701204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d107-63e4-4242-83b1-46c51fc7233d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:11.720853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 866/1718] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:11.723434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:11.763085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c4aae-7970-44d9-953f-604e731755c0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:11.769237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:11.770912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:11.771282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:11.772149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] PATH_INFO: `/v3/projects/5dd2c30cdcbf444e9c7e7d1372dd24a9/users/cd6a0a8c93f549079bb8c0704978ccc4/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:11.846072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd2c30cdcbf444e9c7e7d1372dd24a9, user_id=cd6a0a8c93f549079bb8c0704978ccc4, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:11.849188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:11.937766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 853/1719] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:11 2022] PUT /identity/v3/projects/5dd2c30cdcbf444e9c7e7d1372dd24a9/users/cd6a0a8c93f549079bb8c0704978ccc4/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:11.944384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:11.944668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:11.946150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:12.022755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] MFA Rules not processed for user `cd6a0a8c93f549079bb8c0704978ccc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:12.024271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:12.214737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:12.215077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 867/1720] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:12.395204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cf1a9-5bb3-44fe-9e51-5711aa4ed4d2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:12.406700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:12.407381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:12.407662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:12.407933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:12.408632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:12.410646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:12.466534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:12.468463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:12.510679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408afb7-5cf0-4850-a127-febd9a7ea734 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:12.533318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:12.536696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:12.536981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:12.537258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] PATH_INFO: `/v3/projects/2bd2692bee354697971c77a5a0c90f98` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:12.539526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd2692bee354697971c77a5a0c90f98)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:12.541802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:12.569531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 854/1721] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:12 2022] POST /identity/v3/projects => generated 375 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:12.574443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:12.816995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd2692bee354697971c77a5a0c90f98', 'request_id': 'req-1a33c01c-52a5-4689-8aed-e5580934fc8d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:12.841349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67ccd4-3d07-4f5a-88fa-8bd506470ed7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:12.842640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd2692bee354697971c77a5a0c90f98', 'request_id': 'req-1a33c01c-52a5-4689-8aed-e5580934fc8d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:12.870500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd2692bee354697971c77a5a0c90f98', 'request_id': 'req-1a33c01c-52a5-4689-8aed-e5580934fc8d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.001131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] The token cache is being invalidate because project 2bd2692bee354697971c77a5a0c90f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:13.001422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.006136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.014660 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 868/1722] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:12 2022] DELETE /identity/v3/projects/2bd2692bee354697971c77a5a0c90f98 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:13.015633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:13.022248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:13.159466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:13.164050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:13.164050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:13.164050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:13.164050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:13.174613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:13.219141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33c01c-52a5-4689-8aed-e5580934fc8d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:13.234588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:13.235424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:13.235703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:13.243645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] PATH_INFO: `/v3/projects/32a30f88009f45e2bf34da32431d651f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:13.245901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a30f88009f45e2bf34da32431d651f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:13.248512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:13.286049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 855/1723] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:12 2022] POST /identity/v3/users => generated 294 bytes in 712 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:13.290232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:13.293072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:13.337505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1035-fc96-413b-b7b1-a2cc64e487a6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:13.356598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:13.360699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:13.363331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:13.363872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] PATH_INFO: `/v3/users/7f057836299e4fc49c55dfb457c5257a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:13.370980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f057836299e4fc49c55dfb457c5257a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:13.370980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:13.421754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a30f88009f45e2bf34da32431d651f', 'request_id': 'req-d7408511-f1cc-4f17-ae19-79fc0b520044'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.437254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a30f88009f45e2bf34da32431d651f', 'request_id': 'req-d7408511-f1cc-4f17-ae19-79fc0b520044'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.444674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a30f88009f45e2bf34da32431d651f', 'request_id': 'req-d7408511-f1cc-4f17-ae19-79fc0b520044'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.569685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] The token cache is being invalidate because project 32a30f88009f45e2bf34da32431d651f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:13.570637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.572420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.576123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 869/1724] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:13 2022] DELETE /identity/v3/projects/32a30f88009f45e2bf34da32431d651f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:13.577446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:13.585646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:13.700864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f057836299e4fc49c55dfb457c5257a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.720284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f057836299e4fc49c55dfb457c5257a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.805278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7408511-f1cc-4f17-ae19-79fc0b520044 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:13.838228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f057836299e4fc49c55dfb457c5257a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.841765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:13.843515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:13.843515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:13.844077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:13.845113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:13.846894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:13.866874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f057836299e4fc49c55dfb457c5257a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.867822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f057836299e4fc49c55dfb457c5257a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:13.878019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 870/1725] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:13.879259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:13.886997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:13.903126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 856/1726] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:13 2022] DELETE /identity/v3/users/7f057836299e4fc49c55dfb457c5257a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:13.903126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:13.912145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:13.926356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90702d-d2a2-4484-909e-b7152bb758e1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:14.074457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:14.076689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.076689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.076689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] PATH_INFO: `/v3/users/559aaadbac3041598941ac0ce6a88229` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.077415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=559aaadbac3041598941ac0ce6a88229)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:14.079414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:14.100668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88249af8-6d3c-4609-8161-6372ed89e136 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:14.115794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:14.116876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.117376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.117822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] PATH_INFO: `/v3/projects/38951a9a488144da9ff2b05f67413697/users/712e69dc0fa540d2ae7d8d877199c764/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.160535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38951a9a488144da9ff2b05f67413697, user_id=712e69dc0fa540d2ae7d8d877199c764, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:14.164088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b452d-641b-4b52-ba30-c341bbf7ccb4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:14.288703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 857/1727] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:13 2022] PUT /identity/v3/projects/38951a9a488144da9ff2b05f67413697/users/712e69dc0fa540d2ae7d8d877199c764/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:14.291940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2083-a670-48a1-9f82-5f288557cd9a None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.292235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2083-a670-48a1-9f82-5f288557cd9a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.292516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2083-a670-48a1-9f82-5f288557cd9a None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.299028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 858/1728] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:31:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:31:14.308537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e212e-7f94-4728-b2fd-55fc7a0f242f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.309128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e212e-7f94-4728-b2fd-55fc7a0f242f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.310739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e212e-7f94-4728-b2fd-55fc7a0f242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.382517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559aaadbac3041598941ac0ce6a88229'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:14.399522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559aaadbac3041598941ac0ce6a88229'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:14.433933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559aaadbac3041598941ac0ce6a88229'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:14.435194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559aaadbac3041598941ac0ce6a88229'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:14.447841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7d5e212e-7f94-4728-b2fd-55fc7a0f242f None None] MFA Rules not processed for user `d7dc29e12afd4eccb3a311ebaa3061ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:14.458107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7d5e212e-7f94-4728-b2fd-55fc7a0f242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:14.532933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559aaadbac3041598941ac0ce6a88229'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:14.542486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 871/1729] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:13 2022] DELETE /identity/v3/users/559aaadbac3041598941ac0ce6a88229 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:14.543565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:14.549437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:14.707795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 859/1730] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:14.713849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.714220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.714519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.743662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec01a4-5d01-442f-a46d-95bc213961ae admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:14.757987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:14.759363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.759511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.763200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.764019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:14.767910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410e52a-7a87-498b-ab5e-4eb541212a47 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:14.798217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 872/1731] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:14.803278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f13a-09dc-4ddf-9a22-dd06b94e0e0d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:14.803661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f13a-09dc-4ddf-9a22-dd06b94e0e0d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:14.803953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f13a-09dc-4ddf-9a22-dd06b94e0e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:14.820146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:14.825865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:14.854914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ea68f13a-09dc-4ddf-9a22-dd06b94e0e0d None None] MFA Rules not processed for user `0092d4e191b14af3b1f799271c19fa73`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:14.856099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ea68f13a-09dc-4ddf-9a22-dd06b94e0e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.027145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 873/1732] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:15.034611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:15.037523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:15.037523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:15.078868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] MFA Rules not processed for user `d7dc29e12afd4eccb3a311ebaa3061ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:15.096897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.099404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 860/1733] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:15.100805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:15.143039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f2f9-5e62-4614-9c55-708560758c2a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:15.152545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:15.153721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:15.155524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:15.156063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] PATH_INFO: `/v3/projects/38951a9a488144da9ff2b05f67413697/users/712e69dc0fa540d2ae7d8d877199c764/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:15.159009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38951a9a488144da9ff2b05f67413697, user_id=712e69dc0fa540d2ae7d8d877199c764, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:15.163804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:15.179875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 861/1734] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:15 2022] PUT /identity/v3/projects/38951a9a488144da9ff2b05f67413697/users/712e69dc0fa540d2ae7d8d877199c764/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:15.181151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:15.195471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.360867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 874/1735] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:15.360867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:15.365350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.375564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a124-acf5-4739-9f3d-1c3ca2ebcbb1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:15.389947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:15.390575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:15.390860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:15.391136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:15.443425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca656e-33f4-483d-955b-08f0cd71c0fa None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:15.461126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:15.462141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:15.462141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:15.462778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:15.497799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:15.500800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8d999-b04c-4882-b94a-c90855f7b2d8 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:15.534969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:15.536612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:15.548367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 875/1736] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:15.549880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:15.550175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:15.550459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:15.577439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 862/1737] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:15.635581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] MFA Rules not processed for user `712e69dc0fa540d2ae7d8d877199c764`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:15.636946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.680905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:15.683003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.872643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 876/1738] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:15.884120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:15.885961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:15.979398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa32de-7aef-45d7-93cf-a9c06f606714 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:16.006417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:16.007415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:16.007824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:16.007987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] PATH_INFO: `/v3/projects/9dab1c36d8b5424f97428324fb9ca32c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:16.015412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dab1c36d8b5424f97428324fb9ca32c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:16.016077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fabd9e-2159-4b2b-b807-07e240f5d9ac None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:16.020949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: WARNING py.warnings [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 25 03:31:16.020949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: warnings.warn(msg) Mar 25 03:31:16.020949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: Mar 25 03:31:16.026273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:16.032935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:16.037406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:16.037406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:16.037406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:16.049257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:16.242070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:16.244018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:16.274968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 877/1739] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:16.278983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:16.279136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dab1c36d8b5424f97428324fb9ca32c', 'request_id': 'req-5f522b25-3b6f-4b91-8122-2becd51904b2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:16.290174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dab1c36d8b5424f97428324fb9ca32c', 'request_id': 'req-5f522b25-3b6f-4b91-8122-2becd51904b2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:16.314110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858bc2-61d6-42c2-a4e5-6ac4a17d4b00 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:16.386280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dab1c36d8b5424f97428324fb9ca32c', 'request_id': 'req-5f522b25-3b6f-4b91-8122-2becd51904b2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:16.471316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] The token cache is being invalidate because project 9dab1c36d8b5424f97428324fb9ca32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:16.471614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:16.482069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:16.489430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 863/1740] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:15 2022] DELETE /identity/v3/projects/9dab1c36d8b5424f97428324fb9ca32c => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:16.490047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:16.496831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:16.632659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:16.633398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:16.633697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:16.633990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:16.650848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:16.728402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522b25-3b6f-4b91-8122-2becd51904b2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:16.757277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:16.761617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:16.765235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:16.765475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] PATH_INFO: `/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:16.768621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fcf55a5c0343feb3c36cf1167238fd)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:16.773858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:16.925575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:16.927246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd0f79-9b07-4aa9-8976-d2094a44b453 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:16.977871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 878/1741] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:16.990724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45508-84c1-4262-b5c6-5f6707bc1dde None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:16.991113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45508-84c1-4262-b5c6-5f6707bc1dde None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:16.991349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a45508-84c1-4262-b5c6-5f6707bc1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:16.995417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fcf55a5c0343feb3c36cf1167238fd', 'request_id': 'req-26ee5d74-3900-40d3-9db7-d1e5e055b957'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:17.026885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fcf55a5c0343feb3c36cf1167238fd', 'request_id': 'req-26ee5d74-3900-40d3-9db7-d1e5e055b957'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:17.074200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-01a45508-84c1-4262-b5c6-5f6707bc1dde None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:17.077186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-01a45508-84c1-4262-b5c6-5f6707bc1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:17.178965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fcf55a5c0343feb3c36cf1167238fd', 'request_id': 'req-26ee5d74-3900-40d3-9db7-d1e5e055b957'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:17.205039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] The token cache is being invalidate because project e4fcf55a5c0343feb3c36cf1167238fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:17.207930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:17.210040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-26ee5d74-3900-40d3-9db7-d1e5e055b957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:17.218351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 864/1742] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:16 2022] DELETE /identity/v3/projects/e4fcf55a5c0343feb3c36cf1167238fd => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:17.232048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d13b2-78ec-470c-a705-b645e7a64232 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.244068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d13b2-78ec-470c-a705-b645e7a64232 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.245749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d13b2-78ec-470c-a705-b645e7a64232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.276439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 879/1743] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:17.282790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.283303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.283773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.326481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:17.327927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:17.328322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f89d13b2-78ec-470c-a705-b645e7a64232 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:17.335051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f89d13b2-78ec-470c-a705-b645e7a64232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:17.347299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 880/1744] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:17.351944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:17.370867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 865/1745] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:17.381938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.381938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.382422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.414340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148433-8c54-429c-a11e-f26bdc6123c9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:17.423065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:17.425164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.425959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.446769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:17.451263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.451564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:17.455590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:17.458839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:17.474216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 866/1746] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:17.478464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:17.493704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:17.512634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f4c1-dbda-4a70-a057-ef12d106f74c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:17.560884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:17.560884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.560884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.560884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.561416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:17.561416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:17.561416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:17.591559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 881/1747] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:17.598014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:17.614213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 867/1748] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:31:17.623634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:17.637886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb3c7-c861-4358-b7f2-261e66095d2c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:17.673310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:17.675195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cfb2e-0851-4702-9599-29217ffb098e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:17.676462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.677477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.678493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.680269 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:17.686318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:17.694884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:17.696021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:17.696621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:17.698256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:17.701918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:17.705966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:17.918217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 868/1749] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:17.921561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 882/1750] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:17.921813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:17.923052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.148068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30828b5-05a5-46f2-b072-05a3347a0da9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.168140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.174569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.174569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.174569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.174569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.174569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.182853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a54b-d9b5-4b48-9435-d0c9b6f49a85 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.197456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.198360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.198727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.198907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.199607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.208024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.287778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 883/1751] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:18.294032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.312843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af716f-dbd2-4fce-89b6-33ec849ae2b7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.321467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 869/1752] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:17 2022] POST /identity/v3/users => generated 291 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:18.326907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.339887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.340586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.340865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.341136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.341927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.343578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.350500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feace5-6937-4e28-9b00-706fb44a7416 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.375289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.375289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.375289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.375289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.375646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.375646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.379136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 884/1753] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:18.390763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.409484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 870/1754] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:18.424109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.425893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205923c-a789-46e0-9bc8-7fdd62abd76c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.438848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.439574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.439914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.440089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.442672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827301-62cd-4566-9e2d-8963c2242c85 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.450532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.452230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.471117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.471987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.472689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.473007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.473772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.475440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.486994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 885/1755] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:18.495223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.515565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 871/1756] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:18.520791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:18.523461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e5f2-5250-42dc-818e-b1bcf6dcd02e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.544012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.544916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.545192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.545466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] PATH_INFO: `/v3/projects/87ac90bce5d44bfca4d7dfb0b8024040/users/4a44ee9a31444d0c9fe72a5312066d09/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.554173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c46587-cf11-44c0-9b65-4c9a059200f1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:18.574355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:18.575320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.575599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.575872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] PATH_INFO: `/v3/projects/b634702beaa74ec5a9e91b91c23313df/users/48e1360b8f5d42d194d88b8ddedfa584/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.596977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ac90bce5d44bfca4d7dfb0b8024040, user_id=4a44ee9a31444d0c9fe72a5312066d09, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.600029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b667d4-2b7e-425e-aa3a-247899c90a34 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.619691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b634702beaa74ec5a9e91b91c23313df, user_id=48e1360b8f5d42d194d88b8ddedfa584, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:18.622663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042f39e-1733-47a4-b98b-ca06daa92eec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:18.748701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 886/1757] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:18 2022] PUT /identity/v3/projects/87ac90bce5d44bfca4d7dfb0b8024040/users/4a44ee9a31444d0c9fe72a5312066d09/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:18.752806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.753095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.753378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.769395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 872/1758] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:18 2022] PUT /identity/v3/projects/b634702beaa74ec5a9e91b91c23313df/users/48e1360b8f5d42d194d88b8ddedfa584/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:18.782677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:18.787843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:18.787843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:18.845280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] MFA Rules not processed for user `4a44ee9a31444d0c9fe72a5312066d09`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:18.850937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:18.879018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] MFA Rules not processed for user `48e1360b8f5d42d194d88b8ddedfa584`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:18.880244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:18.970963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 887/1759] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:18.972090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.073531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f3a2f-d4c2-4b3e-ada4-33b199d86160 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:19.078671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:19.079342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.079625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.079896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.080668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:19.082827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:19.215060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 888/1760] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:18 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:19.216118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.220277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 873/1761] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:19.222949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.260043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ccc8-8437-4495-a354-8e0fed270d7d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:19.371331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44c6-01e9-4938-ae42-20111dbacb33 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:19.388471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:19.389298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.389580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.389916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.390598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:19.392536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682f45c-76dd-4851-8e77-477b0b4a0861 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:19.398829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:19.399881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.400298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.400769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.402086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:19.404385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90808-5f3f-46d1-9a89-6f84d9b9eb92 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:19.522137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 889/1762] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:19 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:19.523638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f49a1-9fa7-4b49-8ced-b3d7eeca79d3 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.523906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f49a1-9fa7-4b49-8ced-b3d7eeca79d3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.524179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f49a1-9fa7-4b49-8ced-b3d7eeca79d3 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.532420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 890/1763] 10.222.0.24 () {54 vars in 912 bytes} [Fri Mar 25 03:31:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:31:19.536558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f49a1-9fa7-4b49-8ced-b3d7eeca79d3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.569211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 874/1764] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:19.571037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.573257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.577560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.641939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f49a1-9fa7-4b49-8ced-b3d7eeca79d3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:19.654811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:19.656035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:19.777458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 875/1765] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:31:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:19.779718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.855385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:19.856025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.856389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.856659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.857392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:19.868240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:19.917322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 891/1766] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:19.918584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:19.924786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:19.963393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8243-e73d-466e-b6cb-e920062f5298 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:19.980949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:19.981696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:19.982016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:19.982374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:19.987110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89314fe-50cb-4b02-ac7c-6e037908373f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.002531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.002983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.003817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.004099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.004377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.005320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.005425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.007577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.026324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 892/1767] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:20.027337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.052073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159458-a8ab-4b3b-adc6-a1cab3e6e6ea service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.062357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.063322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.063791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.064151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] PATH_INFO: `/v3/projects/f59d0f4a634843a6af7cb9966570bc77/users/60d971365c5f42c9a52b68bb5044d10b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.108344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59d0f4a634843a6af7cb9966570bc77, user_id=60d971365c5f42c9a52b68bb5044d10b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.111743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.132705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 876/1768] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:19 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:20.134534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.148136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3995d22-32e6-4fa7-955d-20f67cab6822 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.153993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.155038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.155515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.155999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.156959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.159089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.177650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 877/1769] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:20.179307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.192755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1804ae-a4e2-4736-9fe0-3d2398a68b65 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.198953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.200270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.200714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.207206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] PATH_INFO: `/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9/users/5c953fc062fc4ef5b8fb1479c953255a/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.232672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 893/1770] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:20 2022] PUT /identity/v3/projects/f59d0f4a634843a6af7cb9966570bc77/users/60d971365c5f42c9a52b68bb5044d10b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:20.236698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.269212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2a17bd7bbb4229a6b5508d314896a9, user_id=5c953fc062fc4ef5b8fb1479c953255a, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.273754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.348143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 878/1771] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:20 2022] PUT /identity/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9/users/5c953fc062fc4ef5b8fb1479c953255a/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:20.351216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.393348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54107236-39af-462a-af6f-09504e2aaef0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.546135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.546823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.547100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.547370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.548099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.549765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.553114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c0a66-d19c-4109-b689-7f3289037df6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.559085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.560007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.560295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.560572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.561387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.563735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.578549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 879/1772] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:20.590789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 894/1773] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:20.591002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.591094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.611973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42690-ed3c-4125-b9d6-8da08829b96a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.618147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.619764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.620811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.624550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] PATH_INFO: `/v3/projects/f59d0f4a634843a6af7cb9966570bc77/users/60d971365c5f42c9a52b68bb5044d10b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.626909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59d0f4a634843a6af7cb9966570bc77, user_id=60d971365c5f42c9a52b68bb5044d10b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.629716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb5b0-6712-4c15-85ac-1e43a5f1defe admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.637345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce070-19d3-4b43-810b-a1fbcbb10b6e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:20.643595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 895/1774] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:20 2022] PUT /identity/v3/projects/f59d0f4a634843a6af7cb9966570bc77/users/60d971365c5f42c9a52b68bb5044d10b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:20.678194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ed1e-2dd7-46a9-922d-41a803f22c98 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.678632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ed1e-2dd7-46a9-922d-41a803f22c98 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.679090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ed1e-2dd7-46a9-922d-41a803f22c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.740436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-02a1ed1e-2dd7-46a9-922d-41a803f22c98 None None] MFA Rules not processed for user `60d971365c5f42c9a52b68bb5044d10b`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:20.746598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-02a1ed1e-2dd7-46a9-922d-41a803f22c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:20.818515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:20.819999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.821269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.821729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] PATH_INFO: `/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9/users/5c953fc062fc4ef5b8fb1479c953255a/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:20.833372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2a17bd7bbb4229a6b5508d314896a9, user_id=5c953fc062fc4ef5b8fb1479c953255a, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:20.839746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:20.868194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 880/1775] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:20 2022] PUT /identity/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9/users/5c953fc062fc4ef5b8fb1479c953255a/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:20.868194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:20.872179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:20.951553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 896/1776] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:20.953420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:20.953723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:20.953999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:21.031708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09158e29-8bbb-4d78-9b2c-c6035c996633 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:21.033494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] MFA Rules not processed for user `5c953fc062fc4ef5b8fb1479c953255a`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:21.038485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.045852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:21.048850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:21.049149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:21.049432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] PATH_INFO: `/v3/users/cd6a0a8c93f549079bb8c0704978ccc4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:21.053120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6a0a8c93f549079bb8c0704978ccc4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:21.055114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:21.230370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 897/1777] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:21.230370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:21.230370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.308950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6a0a8c93f549079bb8c0704978ccc4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:21.318685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6a0a8c93f549079bb8c0704978ccc4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:21.381463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23515d41-c853-4018-99c9-6d62a2efbffb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:21.406114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:21.406795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:21.407090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:21.407353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:21.408164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6a0a8c93f549079bb8c0704978ccc4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:21.452432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6a0a8c93f549079bb8c0704978ccc4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:21.456229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6a0a8c93f549079bb8c0704978ccc4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:21.485043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 881/1778] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:20 2022] DELETE /identity/v3/users/cd6a0a8c93f549079bb8c0704978ccc4 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:21.485880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:21.488576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.585358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:21.587146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf0eb3-965e-4a96-a837-f7a3606f9e98 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:21.612285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 898/1779] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:21.617767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:21.618328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:21.618964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:21.659653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:21.661739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.666843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7d3f-cc15-4987-82f9-d7e39d275abc admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:21.682810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:21.683625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:21.683888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:21.684198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:21.686259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.800075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 899/1780] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:21.814983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:21.816925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:21.874799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:21.876708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:21.915303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 882/1781] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:21.972919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a235f-3c73-41b3-beb3-8c66112f1b0f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:21.990390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:21.992477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:21.993606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:21.994253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:22.024050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:22.030591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a63713-7d8c-46ef-8a5b-1feec8916a1e service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:22.059020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 900/1782] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:22.209874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:22.217782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:22.221378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:22.221918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:22.223125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:22.260772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386414-5de8-48d6-bc40-38a0114c6793 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:22.288798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:22.292709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:22.293123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:22.293377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:22.295692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] MFA Rules not processed for user `d7dc29e12afd4eccb3a311ebaa3061ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:22.306052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:22.307743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:22.449419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 901/1783] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:22.451081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:22.475603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749ab3-8af7-47fd-8534-e4920b254dbd None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:22.488587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:22.489646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:22.489955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:22.490282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:22.494803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:22.593113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:22.600088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:22.628655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 883/1784] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:22.680604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:22.683068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:22.704594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 902/1785] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:23.251056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:23.252582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:23.286599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93d3-fc2b-4701-ab77-75560fca95d2 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:23.304927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:23.306114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:23.307164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:23.307602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] PATH_INFO: `/v3/projects/5dd2c30cdcbf444e9c7e7d1372dd24a9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:23.310127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd2c30cdcbf444e9c7e7d1372dd24a9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:23.313232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:23.528502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd2c30cdcbf444e9c7e7d1372dd24a9', 'request_id': 'req-b5b96480-952d-45ac-a1db-9c506057b716'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:23.541703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd2c30cdcbf444e9c7e7d1372dd24a9', 'request_id': 'req-b5b96480-952d-45ac-a1db-9c506057b716'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:23.619131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd2c30cdcbf444e9c7e7d1372dd24a9', 'request_id': 'req-b5b96480-952d-45ac-a1db-9c506057b716'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:23.633330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] The token cache is being invalidate because project 5dd2c30cdcbf444e9c7e7d1372dd24a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:23.638504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:23.640181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:23.642816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 884/1786] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:23 2022] DELETE /identity/v3/projects/5dd2c30cdcbf444e9c7e7d1372dd24a9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:23.646831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:23.660096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e399-414e-402d-8d9f-d0103700352d service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:23.838395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:23.839844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:23.840063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:23.842945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] PATH_INFO: `/v3/users/712e69dc0fa540d2ae7d8d877199c764` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:23.847719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712e69dc0fa540d2ae7d8d877199c764)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:23.859371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:24.184563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:24.186439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:24.207789 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b96480-952d-45ac-a1db-9c506057b716 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:24.218365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:24.219370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:24.222858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:24.223064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] PATH_INFO: `/v3/users/48e1360b8f5d42d194d88b8ddedfa584` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:24.224429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e1360b8f5d42d194d88b8ddedfa584)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:24.228894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:24.238831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712e69dc0fa540d2ae7d8d877199c764'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.272332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712e69dc0fa540d2ae7d8d877199c764'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.296756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712e69dc0fa540d2ae7d8d877199c764'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.299036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712e69dc0fa540d2ae7d8d877199c764'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.395711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0a2af473-39c7-47b9-83ce-dd869b239ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712e69dc0fa540d2ae7d8d877199c764'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.406627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 903/1787] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:23 2022] DELETE /identity/v3/users/712e69dc0fa540d2ae7d8d877199c764 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:24.505699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e1360b8f5d42d194d88b8ddedfa584'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.542549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e1360b8f5d42d194d88b8ddedfa584'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.619551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e1360b8f5d42d194d88b8ddedfa584'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.679782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e1360b8f5d42d194d88b8ddedfa584'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.682662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-921dbdfc-3cfc-4283-9e7c-3c57492e290f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e1360b8f5d42d194d88b8ddedfa584'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:24.695120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6803-ed4d-4563-a6d6-32bdac72877c None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:24.695616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6803-ed4d-4563-a6d6-32bdac72877c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:24.695843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6803-ed4d-4563-a6d6-32bdac72877c None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:24.698100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 904/1788] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:31:24.716342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 885/1789] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:24 2022] DELETE /identity/v3/users/48e1360b8f5d42d194d88b8ddedfa584 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:24.716519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:24.716519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:24.716519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:24.781097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:24.783588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:24.807182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:24.807419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:24.807659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:24.842759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:24.850166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:24.956291 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 905/1790] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:24.969446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:24.979967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:25.033693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 886/1791] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:25.094975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8d75-3362-4ff7-88c2-9356ceaa70a0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:25.107497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:25.108328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:25.108663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:25.108944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:25.135178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:25.140137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4127-dbdc-4d91-a086-eef3a5616762 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:25.178187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 906/1792] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:25.532922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:25.534450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:25.548666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688bdc9-b68e-4d8a-9972-c910955c1c94 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:25.554320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:25.554955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:25.555287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:25.555517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:25.565693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:25.567624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:25.590122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 887/1793] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:25.762995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:25.763901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:25.764891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:25.800613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] MFA Rules not processed for user `0092d4e191b14af3b1f799271c19fa73`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:25.807673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:25.921002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 907/1794] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:26.059194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:26.063049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:26.103550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca4cc-9a67-4abd-96cb-9d3858d2c43e service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:26.130960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:26.132770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.133105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.133558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] PATH_INFO: `/v3/projects/b634702beaa74ec5a9e91b91c23313df` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.137432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b634702beaa74ec5a9e91b91c23313df)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:26.141853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:26.281530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:26.283037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:26.313050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6538f-0b33-470a-acc8-09ab19f3b146 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:26.318790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:26.319667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.320181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.320678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] PATH_INFO: `/v3/projects/38951a9a488144da9ff2b05f67413697` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.322831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38951a9a488144da9ff2b05f67413697)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:26.325436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:26.365458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b634702beaa74ec5a9e91b91c23313df', 'request_id': 'req-7be28e52-bb77-433b-b4b8-bdfb6c499a16'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.375066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b634702beaa74ec5a9e91b91c23313df', 'request_id': 'req-7be28e52-bb77-433b-b4b8-bdfb6c499a16'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.458223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b634702beaa74ec5a9e91b91c23313df', 'request_id': 'req-7be28e52-bb77-433b-b4b8-bdfb6c499a16'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.471811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] The token cache is being invalidate because project b634702beaa74ec5a9e91b91c23313df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:26.472350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.473010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.474832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 888/1795] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:26 2022] DELETE /identity/v3/projects/b634702beaa74ec5a9e91b91c23313df => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:26.479239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:26.480623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:26.543777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be28e52-bb77-433b-b4b8-bdfb6c499a16 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:26.553840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:26.555064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.555358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.555703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] PATH_INFO: `/v3/users/5c953fc062fc4ef5b8fb1479c953255a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.557657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c953fc062fc4ef5b8fb1479c953255a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:26.560790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:26.561160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38951a9a488144da9ff2b05f67413697', 'request_id': 'req-1c5b0460-e97b-4820-beac-b5e2d3971a52'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.568807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38951a9a488144da9ff2b05f67413697', 'request_id': 'req-1c5b0460-e97b-4820-beac-b5e2d3971a52'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.576904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38951a9a488144da9ff2b05f67413697', 'request_id': 'req-1c5b0460-e97b-4820-beac-b5e2d3971a52'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.701176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] The token cache is being invalidate because project 38951a9a488144da9ff2b05f67413697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:26.701176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.702025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1c5b0460-e97b-4820-beac-b5e2d3971a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.706860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 908/1796] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:26 2022] DELETE /identity/v3/projects/38951a9a488144da9ff2b05f67413697 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:26.708483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46bc1f-3e93-46b1-8487-8363054a7763 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.708666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46bc1f-3e93-46b1-8487-8363054a7763 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.709111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46bc1f-3e93-46b1-8487-8363054a7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.738612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2f46bc1f-3e93-46b1-8487-8363054a7763 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:26.740110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2f46bc1f-3e93-46b1-8487-8363054a7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:26.821122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 909/1797] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:26.829341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.829874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.830386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.856352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:26.858507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:26.869758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 910/1798] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:26.878718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:26.890663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c953fc062fc4ef5b8fb1479c953255a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.892103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ac131-9a90-47f0-be39-a0a07fecc7b1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:26.898968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:26.901746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.902129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.902566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.903458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:26.903883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:26.906026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:26.918595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c953fc062fc4ef5b8fb1479c953255a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:26.923674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 911/1799] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:26.928533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:26.967611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05a86-41cb-4092-b369-a0f80fe982a6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:26.975587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:26.976263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:26.976544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:26.976910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:26.977652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:26.980363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:27.104150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c953fc062fc4ef5b8fb1479c953255a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:27.119813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c953fc062fc4ef5b8fb1479c953255a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:27.120792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c953fc062fc4ef5b8fb1479c953255a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:27.127262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 889/1800] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:26 2022] DELETE /identity/v3/users/5c953fc062fc4ef5b8fb1479c953255a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:27.202440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:27.202973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 912/1801] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:26 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:27.206162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:27.383554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8dfee-a84a-4296-83f1-041309dafd41 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:27.490480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:27.491047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:27.491337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:27.494286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:27.495008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:27.500708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:27.618540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 890/1802] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:27 2022] POST /identity/v3/users => generated 289 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:27.621779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:27.632122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c242dd-5ef5-44f5-b080-c7bf400a4a81 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:27.646565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:27.651752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:27.651752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:27.651752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:27.651752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:27.652428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:27.675456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 913/1803] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:27.680755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:27.694125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f8d04-f698-429f-adb1-3c015b4c5800 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:27.703258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:27.704123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:27.705211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:27.705884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:27.709222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:27.709222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afe99c-95d9-47a2-b001-248b32ad3873 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:27.723967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 891/1804] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:27.728954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:27.747541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdcbf4-5312-4f7f-8d70-d035c433e31f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:27.759427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:27.766760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:27.766760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:27.766760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] PATH_INFO: `/v3/projects/6eeefa78e2c84e0d8f5977bdbf23859a/users/c6185005cd96485da2b16b45311e99a0/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:27.777838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeefa78e2c84e0d8f5977bdbf23859a, user_id=c6185005cd96485da2b16b45311e99a0, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:27.780552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:27.878573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 914/1805] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:27 2022] PUT /identity/v3/projects/6eeefa78e2c84e0d8f5977bdbf23859a/users/c6185005cd96485da2b16b45311e99a0/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:27.888757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:27.889051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:27.889497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:27.930785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] MFA Rules not processed for user `c6185005cd96485da2b16b45311e99a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:27.932510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:27.941065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:27.943283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.025792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 892/1806] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:28.030659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.066358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9b518-862f-43c3-879b-b8f15ab61be8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.072452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.073857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.074301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.074888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] PATH_INFO: `/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.076836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2a17bd7bbb4229a6b5508d314896a9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.079149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.198513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185a25-be2b-41c7-bbd5-ac07e431f445 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.209177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.213237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.213712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.214028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.215720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.219479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.247325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2a17bd7bbb4229a6b5508d314896a9', 'request_id': 'req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.254085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2a17bd7bbb4229a6b5508d314896a9', 'request_id': 'req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.300883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2a17bd7bbb4229a6b5508d314896a9', 'request_id': 'req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.349813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 893/1807] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:28 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:28.350876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.354891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.444021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0764-619c-488f-9588-ceb485bad1cf admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.450185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.457288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.457288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.457288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] PATH_INFO: `/v3/users/90904db570144c96b79b98f1748555e3` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.457288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90904db570144c96b79b98f1748555e3)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.457735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] The token cache is being invalidate because project ce2a17bd7bbb4229a6b5508d314896a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:28.457735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.457735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.459580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.460442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 915/1808] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:27 2022] DELETE /identity/v3/projects/ce2a17bd7bbb4229a6b5508d314896a9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:28.464237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.468488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.633189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbb87-d2e6-4a03-a4ae-347e3b3f4fe1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.640150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.646328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.646328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.646328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.646328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.646328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e89c1-ec23-4d53-898d-18eb772822af admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.773353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 916/1809] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:28 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:28.774698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.775021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.775301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.784020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90904db570144c96b79b98f1748555e3'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.791672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90904db570144c96b79b98f1748555e3'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.793428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:28.794683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.803007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 917/1810] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:28.804322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.814126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb526d46-6add-4ed5-be79-6719ba69e906 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.819694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.820468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.820633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.820904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.821754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.826475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88322de3-8e2b-4dd9-a8f1-bda397c8fd70 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.834192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 918/1811] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:28.835485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.835753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.836024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.853756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:28.854929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.862617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 919/1812] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:28.863385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.872851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44bc7-3478-46e7-af98-7b5c132ee026 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.875052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90904db570144c96b79b98f1748555e3'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.878110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.878271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.878410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.878679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.879368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.880950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.888043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90904db570144c96b79b98f1748555e3'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.888703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90904db570144c96b79b98f1748555e3'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:28.891143 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 920/1813] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:28.891902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.893476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.895000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 894/1814] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:28 2022] DELETE /identity/v3/users/90904db570144c96b79b98f1748555e3 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:28.895774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:28.897234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:28.908738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e7f08-d637-45bb-a83d-e0cd8b4bdbc3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.961016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a100b2-5c01-481c-9ea4-9d90d7c8d13d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:28.965760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.966648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.966930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.967205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] PATH_INFO: `/v3/projects/176d2e66273b46159cc9a2e4bb6510f1/users/b6b9de27d9304bdda1c9854dfbd2c2b1/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.969761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:28.970440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.970727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.971004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:28.971721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:28.972027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.973699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a504f53-bca9-4a80-b8f4-c2c47e3cb625 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.982004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=176d2e66273b46159cc9a2e4bb6510f1, user_id=b6b9de27d9304bdda1c9854dfbd2c2b1, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:28.984694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:28.986023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 921/1815] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:28.987287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:28.987577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:28.987855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.006425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:29.007624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.015604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 922/1816] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:29.016436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.025635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895d9d-b736-40b3-8abd-f98c35cce88e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.030387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.033419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.033419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.033419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.033419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.034822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78357ac-e17f-4f2b-ab38-16070ac1c56e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.115432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 895/1817] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:28 2022] PUT /identity/v3/projects/176d2e66273b46159cc9a2e4bb6510f1/users/b6b9de27d9304bdda1c9854dfbd2c2b1/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:29.116291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.117833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.145268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 923/1818] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:29.150953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.150953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.150953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.172389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] MFA Rules not processed for user `b6b9de27d9304bdda1c9854dfbd2c2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:29.173565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.175996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c490-e46c-4045-ae21-48516711d6fc admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.222570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.223207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.223540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.223817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.235112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 924/1819] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:29.235735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.286793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.288244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.298524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 896/1820] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:29.299286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.309326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f173-db86-4ea3-98e6-c77aeeb2fc43 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.310730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e56f8-3452-477b-9fd6-6e38196c58f1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.314217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.314870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.315155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.315430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.315918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.317541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.317864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.317864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.317864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.318097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.326417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.328406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.396783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 897/1821] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:29.398630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.420494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 925/1822] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:29.424241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.437652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b11ba-f652-456f-8151-a7c357bab115 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.480823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c6135-3d71-42ff-b816-104b4b799ec0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.485604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.486330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.486618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.486889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.487619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.489788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.498831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.499507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.499790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.500063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.500929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.502616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.521126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 926/1823] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:29.522164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.532403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213b5f-6812-4982-98a6-e8464ac4ffeb admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.537657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.538338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.538627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.538903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.539614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.541875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.557610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 927/1824] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:29.561802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.572840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 898/1825] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:29.572957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2117d0-85ac-4ea1-bb90-9d81efd30995 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.573813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.576939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.577869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.578150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.578419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] PATH_INFO: `/v3/projects/cac777a79104421da2e7b976c84c1c38/users/14a17850aa18470d96e97bf4d25a375d/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.583541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11825b12-760f-4f6c-b986-a5d33f745ac1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.589541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.590260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.590543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.590819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.591533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.593135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.595069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac777a79104421da2e7b976c84c1c38, user_id=14a17850aa18470d96e97bf4d25a375d, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.598059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0556ed-1e9e-4cca-adf7-7f831e6fc432 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.604114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 899/1826] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:29.607881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.617482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db0898-317e-4785-a55f-3a917307c729 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.624309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.625265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.625635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.625990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] PATH_INFO: `/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9/users/c540116684bb4f31b353ead33799770d/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.643726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aed53e41ac24ce1aacdfa889b6585a9, user_id=c540116684bb4f31b353ead33799770d, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.646477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.659278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 928/1827] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:29 2022] PUT /identity/v3/projects/cac777a79104421da2e7b976c84c1c38/users/14a17850aa18470d96e97bf4d25a375d/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:29.670368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.670869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.671164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.698801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] MFA Rules not processed for user `14a17850aa18470d96e97bf4d25a375d`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:29.700100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.722099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 900/1828] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:29 2022] PUT /identity/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9/users/c540116684bb4f31b353ead33799770d/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:29.730566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.768221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 929/1829] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:29.780165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.781542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.796144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19a7ea-e791-46bf-bc01-ff21d6023929 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.801704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.802436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.802823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.803327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.804191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.805810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.817719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 901/1830] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:29.826973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.832196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd484b7f-01c3-48fb-9b9d-ed1db78e0f86 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.837650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.838576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.838935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.839239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] PATH_INFO: `/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9/users/c540116684bb4f31b353ead33799770d/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.841707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aed53e41ac24ce1aacdfa889b6585a9, user_id=c540116684bb4f31b353ead33799770d, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.844101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.861806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 902/1831] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:29 2022] PUT /identity/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9/users/c540116684bb4f31b353ead33799770d/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:29.863028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:29.865544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208902f-f69b-4fab-afb0-df227dcc82d3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.865880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:29.917977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.919279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.919279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.919652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.933643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6570b-bdc6-475f-9569-0db727cef789 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:29.938985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:29.939840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.940122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.940394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] PATH_INFO: `/v3/projects/75e3d33b344e4282898b0765a1501874` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:29.941637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e3d33b344e4282898b0765a1501874)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.943800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.982349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:29.983835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e18e1e-0a99-4b22-bb49-e521d7e49e13 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:29.992535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 930/1832] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:29.994412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:29.994694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:29.994971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:30.020360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] MFA Rules not processed for user `c540116684bb4f31b353ead33799770d`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:30.021569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:30.054586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e3d33b344e4282898b0765a1501874', 'request_id': 'req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:30.061280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e3d33b344e4282898b0765a1501874', 'request_id': 'req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:30.095162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 931/1833] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:30.096001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:30.107268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b45a26-895e-4887-8d8c-29049311ad6f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:30.170760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:30.171649 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:30.171994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:30.172366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] PATH_INFO: `/v3/users/14a17850aa18470d96e97bf4d25a375d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:30.174044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a17850aa18470d96e97bf4d25a375d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:30.176764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:30.978044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e3d33b344e4282898b0765a1501874', 'request_id': 'req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:30.989493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] The token cache is being invalidate because project 75e3d33b344e4282898b0765a1501874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:30.989807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:30.990441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:30.991998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 903/1834] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:29 2022] DELETE /identity/v3/projects/75e3d33b344e4282898b0765a1501874 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:30.992822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:30.994650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.051475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9a56-f0ba-4788-9fbf-5ed17d3044a8 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.055015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.055647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.056495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.056713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.058483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.095352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a17850aa18470d96e97bf4d25a375d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:31.104130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a17850aa18470d96e97bf4d25a375d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:31.117485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a17850aa18470d96e97bf4d25a375d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:31.119027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a17850aa18470d96e97bf4d25a375d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:31.133002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.135319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a9b75-ac94-4ed9-bb0d-562ce405428b service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.154567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 904/1835] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:31.156077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13379-a463-42e4-a489-3ae02a0b6fe6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.156370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13379-a463-42e4-a489-3ae02a0b6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.156633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13379-a463-42e4-a489-3ae02a0b6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.209953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e6d13379-a463-42e4-a489-3ae02a0b6fe6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:31.214527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e6d13379-a463-42e4-a489-3ae02a0b6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.229638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9f5d2fa-ba37-4a4a-a5bd-911869d51db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a17850aa18470d96e97bf4d25a375d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:31.243191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 905/1836] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:31.244105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 932/1837] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:30 2022] DELETE /identity/v3/users/14a17850aa18470d96e97bf4d25a375d => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:31.244848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.245203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.245483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.246150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.247357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.247763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.272449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:31.273629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.337349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:31.338607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.377030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 933/1838] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:31.383629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:31.395167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d537-ec6e-4c51-b171-a586ed59c2a7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.410603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.412230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.414109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.416062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.417969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:31.419540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.421434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.441069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 934/1839] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:31.446372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:31.463891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 906/1840] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:31.467238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d02-4adf-4f5c-b25f-9e84e61325d4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.473625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.487739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.487739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.487739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.487739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.487739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.488129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:31.489936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:31.643814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 935/1841] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:31 2022] POST /identity/v3/projects => generated 357 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:31.649340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:31.653859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f278510-14d8-456c-b198-cc91a9845aa7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.779933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ad75-2300-4748-9da9-4a55dd80a2ac admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.791199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.793061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.793500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.795190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.796377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.800144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.801220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.802092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.802555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.802977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.814615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.816559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.830965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 907/1842] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:31.933654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 936/1843] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:31 2022] POST /identity/v3/users => generated 279 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:31.939074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:31.951119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d865b-e0a7-4bb0-9c4c-2a41dae3298e service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:31.957863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:31.959421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:31.959931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:31.960850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:31.964289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:31.968155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:31.983611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 908/1844] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:31.992853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.009912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74fee-6196-4269-a1aa-66a0e6a41cf6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.020569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.024473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.024473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.024473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.024473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.027085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc4f98-1da6-4b8c-80e0-ef28e4541bfc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:32.048247 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 937/1845] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:32.052674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.066195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460799-11f2-47da-8b06-3d0ef6ee8472 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.086729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.088918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.089391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.089691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] PATH_INFO: `/v3/projects/4a092ac14de8484c81bb41d893cd22ec/users/226f9879476a4da3b9d233fb9b9ed611/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.113935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a092ac14de8484c81bb41d893cd22ec, user_id=226f9879476a4da3b9d233fb9b9ed611, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.117635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:32.214627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 909/1846] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:32 2022] PUT /identity/v3/projects/4a092ac14de8484c81bb41d893cd22ec/users/226f9879476a4da3b9d233fb9b9ed611/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:32.226065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.226572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.226647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.259477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] MFA Rules not processed for user `226f9879476a4da3b9d233fb9b9ed611`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:32.261441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:32.366844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 938/1847] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:32 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:32.371279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.480062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06931186-68f5-4226-885a-c8f1a24721ee admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.486117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.487625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.488097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.488681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.489583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.492116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:32.634605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 910/1848] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:32 2022] POST /identity/v3/projects => generated 355 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:32.635359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.650335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4c5d0-c438-463a-aef2-30bc1eadc987 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.710617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.715740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:32.773275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.787043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.788782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.790011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.793638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.804768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:32.830243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5c895-f042-49b1-82ec-d307971fcd97 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.847009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.847955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.848242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.848518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] PATH_INFO: `/v3/projects/cac777a79104421da2e7b976c84c1c38` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.850382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac777a79104421da2e7b976c84c1c38)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.852425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:32.951122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 939/1849] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:32 2022] POST /identity/v3/users => generated 284 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:32.959262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:32.976446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f875fe-09cd-4901-8d03-6409fc88e791 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:32.990943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:32.990943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:32.990943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:32.990943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:32.991246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:32.992379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.001392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac777a79104421da2e7b976c84c1c38', 'request_id': 'req-a40d441c-95ba-4d3c-908f-72b2ccd8145f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:33.010074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 940/1850] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:33.010256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac777a79104421da2e7b976c84c1c38', 'request_id': 'req-a40d441c-95ba-4d3c-908f-72b2ccd8145f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:33.014688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.025312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87f5a-3176-4937-a761-aae820c1ff4c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.095063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.096113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.096380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.096780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] PATH_INFO: `/v3/projects/eb50c7cb1eb448c2a02152919502623d/users/7ae23a8623b74098beb8f06b23dfe3f9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.134783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb50c7cb1eb448c2a02152919502623d, user_id=7ae23a8623b74098beb8f06b23dfe3f9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.141392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.148984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac777a79104421da2e7b976c84c1c38', 'request_id': 'req-a40d441c-95ba-4d3c-908f-72b2ccd8145f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:33.184013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] The token cache is being invalidate because project cac777a79104421da2e7b976c84c1c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:33.184312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:33.188011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a40d441c-95ba-4d3c-908f-72b2ccd8145f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:33.190650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 911/1851] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:32 2022] DELETE /identity/v3/projects/cac777a79104421da2e7b976c84c1c38 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:33.198653 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586882f1-2cf8-473c-abac-5d9a3480e549 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.198930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586882f1-2cf8-473c-abac-5d9a3480e549 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.199810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586882f1-2cf8-473c-abac-5d9a3480e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.245193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-586882f1-2cf8-473c-abac-5d9a3480e549 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:33.248455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-586882f1-2cf8-473c-abac-5d9a3480e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:33.274522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 912/1852] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:33.284558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 941/1853] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:33 2022] PUT /identity/v3/projects/eb50c7cb1eb448c2a02152919502623d/users/7ae23a8623b74098beb8f06b23dfe3f9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:33.285028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.285028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.285028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.285645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.288309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:33.333298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:33.335669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:33.452748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 913/1854] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:33.457477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.479852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14ebf-3a2a-47f7-a726-5664207d8d76 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.483401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5682-0ff5-4df1-bc7a-1bde9a81d01a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.496487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.498424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.498691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.500697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.514183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:33.514183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.514621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.514621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.514621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.514886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.514970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.514970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.514970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.534510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 914/1855] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:33.535610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.543846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 942/1856] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:33.544800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.550041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70536e8-2c5d-48ac-9276-41ee5d75ff84 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.556801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.569577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.570220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.570510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.571336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.572954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15a16d-b1e5-43cd-ad13-1690175993a1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.575485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.595920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.596836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.597407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.597978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] PATH_INFO: `/v3/projects/eb50c7cb1eb448c2a02152919502623d/users/7ae23a8623b74098beb8f06b23dfe3f9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.602605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb50c7cb1eb448c2a02152919502623d, user_id=7ae23a8623b74098beb8f06b23dfe3f9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.607894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8c533-f519-44ba-a3d4-e86fabece991 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.628002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 943/1857] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:33 2022] PUT /identity/v3/projects/eb50c7cb1eb448c2a02152919502623d/users/7ae23a8623b74098beb8f06b23dfe3f9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:33.639312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.639724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.642857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.702589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 915/1858] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:33 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:33.706818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.742780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] MFA Rules not processed for user `7ae23a8623b74098beb8f06b23dfe3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:33.747721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:33.839228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957977d8-51d4-4b8a-b226-1994958b8883 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.850308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.851078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.851361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.852087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.852333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:33.854934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff4e5-a55f-4564-a438-0d15637fb468 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:33.879367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 944/1859] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:33.885007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:33.886777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:33.986699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5712597-52dd-4134-8b41-4782ac0a8b42 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:33.993179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:33.998448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:33.998448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:33.998448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:33.998448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.000055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 916/1860] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:33 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:34.001888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.002812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.003304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.006595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 917/1861] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:31:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:31:34.007969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.011886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.032293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eccf8-323d-4022-a442-8ac52edf1bee None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.040225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.042148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.042638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.043247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.059213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.061147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.074127 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 918/1862] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:34.075144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.083929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.090478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329db44-03c6-4f15-b848-8f0e9d902bc0 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.090979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a07e5-6c20-4be3-be56-56b3f331bacf service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.095532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.096309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.096671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.097433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.098293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.100699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.109182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 945/1863] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:34.110473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.110760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.111040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.118299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 919/1864] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:34.122060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.130639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b55dc-54f9-411e-b110-5eda58bb23b9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.137027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.138256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.138796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.139270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.140262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.142153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.152466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:34.158129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.159504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 920/1865] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:34.160605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.172224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23c1d-a62f-4272-ac46-f50f2c4c58d6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.177701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.178910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.179699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.181818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] PATH_INFO: `/v3/projects/46506a8e438d4737a1ca44d48731df78/users/8fbb4f0043b849bf82d558df3c710587/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.198808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46506a8e438d4737a1ca44d48731df78, user_id=8fbb4f0043b849bf82d558df3c710587, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.204524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3be2c-eb02-47af-aa55-5811ec961dc7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.306248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 921/1866] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:34 2022] PUT /identity/v3/projects/46506a8e438d4737a1ca44d48731df78/users/8fbb4f0043b849bf82d558df3c710587/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:34.306248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.306248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.306248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.318175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 946/1867] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:31:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:34.340520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.347163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.362779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] MFA Rules not processed for user `8fbb4f0043b849bf82d558df3c710587`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:34.364224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.382190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea19a31-bbaa-446e-b320-48c882d9f52f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.479933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 922/1868] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:34.480938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:34.583673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0441a15-7835-4c2c-83b1-e6fbd48ab435 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:34.587907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.591500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:34.592115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.592234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.592307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:34.592489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.592583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:34.592838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:34.595339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:34.615850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.617709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.640326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 947/1869] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:34.718022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:34.724386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:34.767856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 923/1870] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:35.482050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:35.496411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c404-3a7f-4a11-ab99-9337513dbc7f service nova] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:35.502418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:35.503492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:35.504196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:35.504775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:35.531861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:35.533324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:35.544858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 948/1871] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:36.606347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:36.618193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb10f-70b9-4f37-86a1-902e21299dc5 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:36.627337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:36.628005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:36.628924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:36.629202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:36.635503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:36.711659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:36.713018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33b2d4-00b6-4a2a-a71d-bc7eff076c43 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:36.744628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 924/1872] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:37.842077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:37.843762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:37.917901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119e52-e3a2-40b5-b7da-da94043cdb6d service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:37.922958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:37.923851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:37.924122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:37.924572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] PATH_INFO: `/v3/users/4a44ee9a31444d0c9fe72a5312066d09` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:37.926057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a44ee9a31444d0c9fe72a5312066d09)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:37.927992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:38.174509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44ee9a31444d0c9fe72a5312066d09'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:38.181912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44ee9a31444d0c9fe72a5312066d09'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:38.193481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44ee9a31444d0c9fe72a5312066d09'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:38.194570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44ee9a31444d0c9fe72a5312066d09'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:38.280188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44ee9a31444d0c9fe72a5312066d09'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:38.286616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 949/1873] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:37 2022] DELETE /identity/v3/users/4a44ee9a31444d0c9fe72a5312066d09 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:38.291876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:38.292340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:38.292428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:38.347003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:38.348246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:38.442263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 925/1874] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:38.450148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:38.451783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:38.541749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240241-84fe-4a38-82aa-8a72b8506e52 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:38.550009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:38.550905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:38.551362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:38.551653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:38.569630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:38.569630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:38.581297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 950/1875] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:39.079939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:39.081537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:39.099535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ee23-cfe6-4196-b487-2a2efc9032d3 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:39.104494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:39.105472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:39.105902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:39.106183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] PATH_INFO: `/v3/projects/87ac90bce5d44bfca4d7dfb0b8024040` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:39.107537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ac90bce5d44bfca4d7dfb0b8024040)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:39.109302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:39.246706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ac90bce5d44bfca4d7dfb0b8024040', 'request_id': 'req-1dc352b4-0182-4d08-b379-fd959d14d2c6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.252243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ac90bce5d44bfca4d7dfb0b8024040', 'request_id': 'req-1dc352b4-0182-4d08-b379-fd959d14d2c6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.314614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ac90bce5d44bfca4d7dfb0b8024040', 'request_id': 'req-1dc352b4-0182-4d08-b379-fd959d14d2c6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.326749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] The token cache is being invalidate because project 87ac90bce5d44bfca4d7dfb0b8024040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:39.327057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.328668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.330356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 926/1876] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:39 2022] DELETE /identity/v3/projects/87ac90bce5d44bfca4d7dfb0b8024040 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:39.334283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:39.344224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4c87-83ea-4528-b0c5-78a8d1516c66 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:39.401877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:39.402748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:39.403014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:39.403284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] PATH_INFO: `/v3/users/60d971365c5f42c9a52b68bb5044d10b` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:39.404523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d971365c5f42c9a52b68bb5044d10b)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:39.406528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:39.618871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d971365c5f42c9a52b68bb5044d10b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.626637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d971365c5f42c9a52b68bb5044d10b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.642569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d971365c5f42c9a52b68bb5044d10b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.643382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d971365c5f42c9a52b68bb5044d10b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.720646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-775b344c-1061-4be3-84b5-7541713470eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d971365c5f42c9a52b68bb5044d10b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:39.731135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 951/1877] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:39 2022] DELETE /identity/v3/users/60d971365c5f42c9a52b68bb5044d10b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:40.230993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:40.233540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:40.250437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc352b4-0182-4d08-b379-fd959d14d2c6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:40.307306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:40.308217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.308501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.308773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] PATH_INFO: `/v3/projects/f59d0f4a634843a6af7cb9966570bc77` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.310003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59d0f4a634843a6af7cb9966570bc77)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:40.311937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:40.441386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59d0f4a634843a6af7cb9966570bc77', 'request_id': 'req-119366ad-f492-4bf9-b34d-64e1e0985b54'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:40.447398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59d0f4a634843a6af7cb9966570bc77', 'request_id': 'req-119366ad-f492-4bf9-b34d-64e1e0985b54'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:40.548665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59d0f4a634843a6af7cb9966570bc77', 'request_id': 'req-119366ad-f492-4bf9-b34d-64e1e0985b54'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:40.561161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] The token cache is being invalidate because project f59d0f4a634843a6af7cb9966570bc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:40.561617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:40.562352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-119366ad-f492-4bf9-b34d-64e1e0985b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:40.563879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 927/1878] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:40 2022] DELETE /identity/v3/projects/f59d0f4a634843a6af7cb9966570bc77 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:40.568851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.569344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.569549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.588433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:40.589639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:40.646673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 952/1879] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:40.655208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.655507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.655785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.673511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:40.674803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:40.683278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 928/1880] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:40.687369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:40.697582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ecbf1-a771-4810-87bf-668d9e21aa07 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:40.702329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:40.703097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.703379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.703652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.704378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:40.704683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:40.706397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:40.718288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 953/1881] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:40.722463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:40.731597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda33f-290f-423c-bfbe-5e7bddc55a99 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:40.736788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:40.737430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.737747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.738027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.738710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:40.740739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:40.867884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 929/1882] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:40.869577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:40.880154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1588b-41ba-41e4-9741-4a6954fbcfe6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:40.948397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:40.949083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:40.952355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:40.952355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:40.952355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:40.952355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.046608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 954/1883] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:40 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:41.050393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.060520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3450cf-fb87-4910-9c4c-43ce6d7e366f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.065184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.065866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.066155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.066432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.067146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.068774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.079461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 930/1884] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:41.083148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.093877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfdad-aae3-4272-abe3-f2b822edffab admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.098423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.099058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.099336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.099611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.100588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.102248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9446-efc9-4340-afe6-153a315ff8a1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.111775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 955/1885] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:41.115638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.125191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b870b-e868-46d6-a85a-8fa0e3beede7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.129718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.130597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.130875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.131149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] PATH_INFO: `/v3/projects/ea60c2c03adf4217b8a463f34c4b0f12/users/1ae2149e671b4f74bff54b695b19919d/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.145373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea60c2c03adf4217b8a463f34c4b0f12, user_id=1ae2149e671b4f74bff54b695b19919d, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.148076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.228982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 931/1886] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:41 2022] PUT /identity/v3/projects/ea60c2c03adf4217b8a463f34c4b0f12/users/1ae2149e671b4f74bff54b695b19919d/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:41.239093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.239377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.239644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.267056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] MFA Rules not processed for user `1ae2149e671b4f74bff54b695b19919d`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:41.268248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:41.330926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 956/1887] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:41.335338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.395288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20513ac0-bdf8-4d7a-af53-85126db267da admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.402267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.403017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.403300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.403573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.404241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.406174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.493248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 932/1888] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:41 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:41.497209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.507997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0532-9f70-4959-8c0a-d1710fa1dc97 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.564279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.564976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.565328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.565614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.569034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.569034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.658198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 957/1889] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:41 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:41.661883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.673870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d90d-d1f7-4ba7-9f3a-6c17fbc470ad admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.678497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.679195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.679474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.679741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.680447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.682161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.692478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 933/1890] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:41.699350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.707166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed757f-5881-4e1f-9ce9-cbff4dbd03dd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.716442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.717319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.717595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.718150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] PATH_INFO: `/v3/projects/21841db6c87b46b8bed04003246d45b1/users/e8bcecc285384073b04581310076a3ae/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.733084 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21841db6c87b46b8bed04003246d45b1, user_id=e8bcecc285384073b04581310076a3ae, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.735887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.853134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 958/1891] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:41 2022] PUT /identity/v3/projects/21841db6c87b46b8bed04003246d45b1/users/e8bcecc285384073b04581310076a3ae/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:41.857446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.867848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94f3e-1798-4e9c-beb8-e66aeb5bd8dd admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.924294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.924954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.925274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.925547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.926285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.927902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e636fd-ac0a-4785-b3d6-5039beb204ae admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.938120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 934/1892] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:41.942439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:41.953387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae02d-fdc8-4594-bd82-e050d38f5366 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:41.961432 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:41.962903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.963198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.963469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] PATH_INFO: `/v3/projects/21841db6c87b46b8bed04003246d45b1/users/e8bcecc285384073b04581310076a3ae/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:41.966391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21841db6c87b46b8bed04003246d45b1, user_id=e8bcecc285384073b04581310076a3ae, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:41.968274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:41.983704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 959/1893] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:41 2022] PUT /identity/v3/projects/21841db6c87b46b8bed04003246d45b1/users/e8bcecc285384073b04581310076a3ae/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:41.995629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:41.995914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:41.996592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:42.025691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] MFA Rules not processed for user `e8bcecc285384073b04581310076a3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:42.027857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:42.106363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 935/1894] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:42.118115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:42.121418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:42.184486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968aec21-6603-4bf5-985a-8af9258ed674 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:42.188274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:42.189101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:42.189101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:42.189393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:42.202644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:42.204112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d6eb-963a-45c7-9906-d12b1cd24024 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:42.214681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 960/1895] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:43.891770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:43.966211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08911-a5e9-4d11-97c4-15f988eaa7fb None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:43.977862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:43.978805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:43.979174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:43.980513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] PATH_INFO: `/v3/users/1ae2149e671b4f74bff54b695b19919d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:43.986307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae2149e671b4f74bff54b695b19919d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:43.989246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:44.170806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae2149e671b4f74bff54b695b19919d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:44.177609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae2149e671b4f74bff54b695b19919d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:44.234605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae2149e671b4f74bff54b695b19919d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:44.247442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae2149e671b4f74bff54b695b19919d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:44.248101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae2149e671b4f74bff54b695b19919d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:44.253976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 936/1896] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:43 2022] DELETE /identity/v3/users/1ae2149e671b4f74bff54b695b19919d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:44.258664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:44.259693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:44.259966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:44.278561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:44.279870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:44.351082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 961/1897] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:44.362220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:44.364613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:44.448440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b36a-1fc6-4292-b537-535ed439278d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:44.452986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:44.453629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:44.453939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:44.454379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:44.467358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:44.469528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:44.490216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 937/1898] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:44.948529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:44.950333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:44.980380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17af7-6f1a-44cf-9d40-48ca075dd498 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:44.985794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:44.986704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:44.986989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:44.987267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] PATH_INFO: `/v3/projects/ea60c2c03adf4217b8a463f34c4b0f12` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:44.988514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea60c2c03adf4217b8a463f34c4b0f12)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:44.990512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:45.126673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea60c2c03adf4217b8a463f34c4b0f12', 'request_id': 'req-e8f1d782-a353-47f6-84a4-bc63e79f148f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.132613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea60c2c03adf4217b8a463f34c4b0f12', 'request_id': 'req-e8f1d782-a353-47f6-84a4-bc63e79f148f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.139042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea60c2c03adf4217b8a463f34c4b0f12', 'request_id': 'req-e8f1d782-a353-47f6-84a4-bc63e79f148f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.199857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] The token cache is being invalidate because project ea60c2c03adf4217b8a463f34c4b0f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:45.200148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.201916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.202328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 962/1899] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:44 2022] DELETE /identity/v3/projects/ea60c2c03adf4217b8a463f34c4b0f12 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:45.206675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:45.217943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0544218-4f88-4d37-874a-3b12ace7a269 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:45.276359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:45.277233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:45.277515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:45.277817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] PATH_INFO: `/v3/users/e8bcecc285384073b04581310076a3ae` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:45.278993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bcecc285384073b04581310076a3ae)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:45.280915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:45.459840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bcecc285384073b04581310076a3ae'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.467555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bcecc285384073b04581310076a3ae'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.531494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bcecc285384073b04581310076a3ae'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.544742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bcecc285384073b04581310076a3ae'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.545607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a8ba5ea8-200c-43ed-9059-10c2076e26c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bcecc285384073b04581310076a3ae'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:45.551804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 938/1900] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:45 2022] DELETE /identity/v3/users/e8bcecc285384073b04581310076a3ae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:46.209380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:46.210929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:46.232927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1d782-a353-47f6-84a4-bc63e79f148f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:46.327730 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:46.329447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.330169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.330801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] PATH_INFO: `/v3/projects/21841db6c87b46b8bed04003246d45b1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.333209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21841db6c87b46b8bed04003246d45b1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:46.335845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:46.441072 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21841db6c87b46b8bed04003246d45b1', 'request_id': 'req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:46.447483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21841db6c87b46b8bed04003246d45b1', 'request_id': 'req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:46.454920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21841db6c87b46b8bed04003246d45b1', 'request_id': 'req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:46.535497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] The token cache is being invalidate because project 21841db6c87b46b8bed04003246d45b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:46.535857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:46.536582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c17ffd31-3d7b-4c80-9828-f7d29d462fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:46.541206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 963/1901] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:46 2022] DELETE /identity/v3/projects/21841db6c87b46b8bed04003246d45b1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:46.546104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.546602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.546713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.564742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:46.566024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:46.623427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 939/1902] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:46.631466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.631790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.632076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.651136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:46.652331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:46.664392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 964/1903] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:46.665361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:46.678023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9b8e-ad4b-4f39-b8d4-92d823662523 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:46.684982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:46.686084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.689173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.689173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.689173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:46.689173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:46.689554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:46.703338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 940/1904] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:31:46.707967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:46.729027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea514ddd-ec1d-4443-b076-0dc48b40bfd7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:46.735413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:46.736201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.736580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.736951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.737816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:46.739906 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:46.830146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:46.831839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:46.845066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0deb6-8c40-4745-a42f-1a04d744d51f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:46.849960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:46.850820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:46.851105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:46.851403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] PATH_INFO: `/v3/users/c6185005cd96485da2b16b45311e99a0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:46.852636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6185005cd96485da2b16b45311e99a0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:46.854792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:46.946096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 965/1905] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:46 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:46.950367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.026045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f0f6-a018-48da-bb09-d2ea6bcef694 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.032721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.033433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.033741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.034016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.036469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.037008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.052666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6185005cd96485da2b16b45311e99a0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:47.064530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6185005cd96485da2b16b45311e99a0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:47.149540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 966/1906] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:46 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:47.153872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.163723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a668-4297-4bde-88a0-a64a05c77ca8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.168831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.169512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.169816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.170254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.171696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6185005cd96485da2b16b45311e99a0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:47.171811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.173485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.185286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 967/1907] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:47.189314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.193483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6185005cd96485da2b16b45311e99a0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:47.193483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4a3ab933-b936-4dc1-b861-a9a6834f6cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6185005cd96485da2b16b45311e99a0'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:47.198526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 941/1908] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:46 2022] DELETE /identity/v3/users/c6185005cd96485da2b16b45311e99a0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:47.199397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa322-352e-4188-a318-41dcc5104cca admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.202923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.203623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.204788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.233640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:47.236815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:47.302017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.302900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.303198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.303476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.308055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.308055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.317887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 968/1909] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:47.322006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.323367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 942/1910] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:47.323920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:47.333438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.334894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:47.339190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa82a8-34eb-4204-a2b1-f3a79070be2f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.344661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.345604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.345921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.346195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] PATH_INFO: `/v3/projects/4c2c7a618a354e038532f14350aae63f/users/8a79d42c6dd94c4abc4844d084338ec5/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.363343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2c7a618a354e038532f14350aae63f, user_id=8a79d42c6dd94c4abc4844d084338ec5, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.366094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.406350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e7e9-952d-4231-ad59-476765fec394 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.410406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.411052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.411327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.411594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.422197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.423797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f737-2560-4c11-8582-b7139ee1cee5 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.434340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 943/1911] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:47.446571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 969/1912] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:47 2022] PUT /identity/v3/projects/4c2c7a618a354e038532f14350aae63f/users/8a79d42c6dd94c4abc4844d084338ec5/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:47.456737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.457025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.457303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.486910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] MFA Rules not processed for user `8a79d42c6dd94c4abc4844d084338ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:47.488124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:47.561677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 944/1913] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:47.566240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.630939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b3422-786a-485f-bc86-bb49cf34cfb8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.644129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.645064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.645422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.645850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.646619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.649125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.730101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 970/1914] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:47 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:47.731667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.742669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad59fdb-3137-4f67-ad52-bc5de6ccf565 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.800605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.801347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.801741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.802214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.802918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.804994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.860036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.861954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:47.875196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342a24d-89e0-4aba-b46b-ab5bb5117bcd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.885347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 945/1915] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:47 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:47.885834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.885834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.885834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.885834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] PATH_INFO: `/v3/projects/6eeefa78e2c84e0d8f5977bdbf23859a` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.886301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eeefa78e2c84e0d8f5977bdbf23859a)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.886507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.886898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.898239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442c76-4c36-4ab4-8bc8-3040c5782c55 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.903803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.904508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.904863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.905208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.906087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.907816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:47.918434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 946/1916] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:47.922404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:47.931758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac394ed-104e-4ead-9570-e3763083a791 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:47.936550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:47.937411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:47.937713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:47.937990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] PATH_INFO: `/v3/projects/7e81fe7f290246a3929973e1fc72ddb1/users/e80846172cf341df83ceb2f077bc90ed/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:47.952953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e81fe7f290246a3929973e1fc72ddb1, user_id=e80846172cf341df83ceb2f077bc90ed, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:47.955675 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:48.046823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 947/1917] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:47 2022] PUT /identity/v3/projects/7e81fe7f290246a3929973e1fc72ddb1/users/e80846172cf341df83ceb2f077bc90ed/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:48.050658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:48.058280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eeefa78e2c84e0d8f5977bdbf23859a', 'request_id': 'req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.064959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eeefa78e2c84e0d8f5977bdbf23859a', 'request_id': 'req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.072933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eeefa78e2c84e0d8f5977bdbf23859a', 'request_id': 'req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.112485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15a80-1ee7-4cc5-b8bd-0729532c65ec admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:48.165859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:48.166522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:48.166802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:48.167072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:48.167783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:48.169384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:48.177423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] The token cache is being invalidate because project 6eeefa78e2c84e0d8f5977bdbf23859a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:48.181743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.181743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.181937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 948/1918] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:48.182026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 971/1919] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:47 2022] DELETE /identity/v3/projects/6eeefa78e2c84e0d8f5977bdbf23859a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:48.184311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:48.184488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:48.185901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:48.186005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:48.198808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811dbd7-ec9e-4e0f-a1f7-8c8c210dcd6e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:48.198980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7acbdf-302a-4c5e-b999-e02b8150b604 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:48.203465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:48.203605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:48.204382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:48.204490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:48.204646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:48.204740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:48.204942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] PATH_INFO: `/v3/users/b6b9de27d9304bdda1c9854dfbd2c2b1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:48.205032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] PATH_INFO: `/v3/projects/7e81fe7f290246a3929973e1fc72ddb1/users/e80846172cf341df83ceb2f077bc90ed/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:48.206160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b9de27d9304bdda1c9854dfbd2c2b1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:48.212241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e81fe7f290246a3929973e1fc72ddb1, user_id=e80846172cf341df83ceb2f077bc90ed, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:48.212358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:48.212440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d69bf-6fe1-49ce-a7f2-acda24e1bcce admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:48.231423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 972/1920] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:48 2022] PUT /identity/v3/projects/7e81fe7f290246a3929973e1fc72ddb1/users/e80846172cf341df83ceb2f077bc90ed/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:48.233549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:48.233900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:48.234174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:48.260156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] MFA Rules not processed for user `e80846172cf341df83ceb2f077bc90ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:48.261323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:48.330358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 973/1921] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:48.342472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:48.348299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:48.399826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de773-76c8-4341-9bbb-0d187a7f9dd0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:48.403567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:48.404233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:48.404508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:48.404778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:48.407769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b9de27d9304bdda1c9854dfbd2c2b1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.413896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:48.414543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b9de27d9304bdda1c9854dfbd2c2b1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.415913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:48.425362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 974/1922] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:31:48.458122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b9de27d9304bdda1c9854dfbd2c2b1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.474165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b9de27d9304bdda1c9854dfbd2c2b1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.474872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b9de27d9304bdda1c9854dfbd2c2b1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:48.483578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 949/1923] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:48 2022] DELETE /identity/v3/users/b6b9de27d9304bdda1c9854dfbd2c2b1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:48.914299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:49.018538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f76633-6d2c-4a3a-8439-50d93caad7e4 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:49.093183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:49.094161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:49.094510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:49.094896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] PATH_INFO: `/v3/projects/176d2e66273b46159cc9a2e4bb6510f1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:49.096223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=176d2e66273b46159cc9a2e4bb6510f1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:49.098524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:49.257064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176d2e66273b46159cc9a2e4bb6510f1', 'request_id': 'req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.262389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176d2e66273b46159cc9a2e4bb6510f1', 'request_id': 'req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.268836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176d2e66273b46159cc9a2e4bb6510f1', 'request_id': 'req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.354647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] The token cache is being invalidate because project 176d2e66273b46159cc9a2e4bb6510f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:49.355286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.355526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.357621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 975/1924] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:48 2022] DELETE /identity/v3/projects/176d2e66273b46159cc9a2e4bb6510f1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:49.361549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:49.363124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:49.379775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:49.382889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873880e6-ecc6-4a08-9c26-414d4c0b4321 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:49.384200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:49.449922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:49.450794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:49.451076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:49.451350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] PATH_INFO: `/v3/users/c540116684bb4f31b353ead33799770d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:49.452533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c540116684bb4f31b353ead33799770d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:49.454591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:49.459922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281bf6-4d54-4ebc-b1c3-69a11630e5ba admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:49.465858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:49.466897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:49.467335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:49.467684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] PATH_INFO: `/v3/users/8a79d42c6dd94c4abc4844d084338ec5` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:49.469388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a79d42c6dd94c4abc4844d084338ec5)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:49.471528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:49.655304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c540116684bb4f31b353ead33799770d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.663346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c540116684bb4f31b353ead33799770d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.692773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a79d42c6dd94c4abc4844d084338ec5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.700545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a79d42c6dd94c4abc4844d084338ec5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.713349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a79d42c6dd94c4abc4844d084338ec5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.714381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a79d42c6dd94c4abc4844d084338ec5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.750243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c540116684bb4f31b353ead33799770d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.766664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c540116684bb4f31b353ead33799770d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.767487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f829e122-2177-4abd-840b-e600449a1f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c540116684bb4f31b353ead33799770d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.774111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 950/1925] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:49 2022] DELETE /identity/v3/users/c540116684bb4f31b353ead33799770d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:49.847558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a79d42c6dd94c4abc4844d084338ec5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:49.857923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 976/1926] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:49 2022] DELETE /identity/v3/users/8a79d42c6dd94c4abc4844d084338ec5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:49.861685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:49.862060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:49.862334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:49.903787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:49.905124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:49.976097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 951/1927] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:49.985751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:49.987163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:50.049733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684639-e7c8-4323-80e3-7fe2ba614424 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:50.053605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:50.054314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:50.054672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:50.055043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:50.064909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:50.066503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:50.077510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 977/1928] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:50.691351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:50.692742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:50.714561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3b242-2a2f-420b-9c25-a139971dae36 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:50.720175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:50.721499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:50.722025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:50.722509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] PATH_INFO: `/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:50.724122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aed53e41ac24ce1aacdfa889b6585a9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:50.727367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:50.943808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aed53e41ac24ce1aacdfa889b6585a9', 'request_id': 'req-2b31c2f5-a587-48b0-a5c8-1219a6aff673'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:50.950502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aed53e41ac24ce1aacdfa889b6585a9', 'request_id': 'req-2b31c2f5-a587-48b0-a5c8-1219a6aff673'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.088250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.089762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.117443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f5b5-4245-4cb3-b25f-d50eff74227f service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.147298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aed53e41ac24ce1aacdfa889b6585a9', 'request_id': 'req-2b31c2f5-a587-48b0-a5c8-1219a6aff673'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.165995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] The token cache is being invalidate because project 6aed53e41ac24ce1aacdfa889b6585a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:51.167740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.171659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b31c2f5-a587-48b0-a5c8-1219a6aff673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.180169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 952/1929] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:50 2022] DELETE /identity/v3/projects/6aed53e41ac24ce1aacdfa889b6585a9 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:51.182350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44088-8206-4017-9d7c-c311ed45102d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.182624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44088-8206-4017-9d7c-c311ed45102d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.182899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44088-8206-4017-9d7c-c311ed45102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.207213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.208088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.208364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.208702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] PATH_INFO: `/v3/projects/4c2c7a618a354e038532f14350aae63f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.210073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2c7a618a354e038532f14350aae63f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.210186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-56b44088-8206-4017-9d7c-c311ed45102d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:51.212659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.213321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-56b44088-8206-4017-9d7c-c311ed45102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.235360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 953/1930] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:51.245197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.245489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.245795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.279583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:51.280818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.299838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 954/1931] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:51.306420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.319524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb61e2-fcaa-4a7b-88ca-fafe14071455 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.327151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.328078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.328578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.328991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.329913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:51.330410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.332353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.348147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 955/1932] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:51.353149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.370051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e5a2-834a-41ef-a882-10d7cc17ee1f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.372292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2c7a618a354e038532f14350aae63f', 'request_id': 'req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.383424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2c7a618a354e038532f14350aae63f', 'request_id': 'req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.395344 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2c7a618a354e038532f14350aae63f', 'request_id': 'req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.479405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.480284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.480776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.481100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.481991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.485252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.521244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] The token cache is being invalidate because project 4c2c7a618a354e038532f14350aae63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:51.521974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.523992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.524446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 978/1933] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:51 2022] DELETE /identity/v3/projects/4c2c7a618a354e038532f14350aae63f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:51.528371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.529997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.546828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdf81-f2ba-48a3-b164-bc4786ec5cd6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.553491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.554428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.554710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.565732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] PATH_INFO: `/v3/users/e80846172cf341df83ceb2f077bc90ed` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.565732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80846172cf341df83ceb2f077bc90ed)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.565732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.595890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 956/1934] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:51 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:51.600044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.601770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.676018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc454-08ba-443f-ac83-aca259f3a4b9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.681679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.682523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.682811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.683088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.683779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.686189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.892291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 957/1935] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:51 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:51.896186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.905566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae82c1-038d-401c-9acf-258e41d45cc9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.910178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.910804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.911085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.911362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.912064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.913650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.923284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 958/1936] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:51.927027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.928699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80846172cf341df83ceb2f077bc90ed'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.935966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80846172cf341df83ceb2f077bc90ed'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.937105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4887b-6783-4678-8399-f9014b63f37c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.941792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.942427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.942715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.942985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.943686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.945273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:51.948991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80846172cf341df83ceb2f077bc90ed'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.949743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80846172cf341df83ceb2f077bc90ed'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:51.955956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 959/1937] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:51.960084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:51.962450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:51.974892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ddb8-fefa-4d89-ac08-f7d4934863af admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:51.979600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:51.980456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:51.980731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:51.980997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] PATH_INFO: `/v3/projects/39521e840ab849668922a636d7348eb9/users/2a1402ffc4ec4ec2bc1e197b79987595/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:51.995695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39521e840ab849668922a636d7348eb9, user_id=2a1402ffc4ec4ec2bc1e197b79987595, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:51.998406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ad54b-c7dd-49c2-8b65-b9402a2b13c2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:52.109005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80846172cf341df83ceb2f077bc90ed'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:52.118765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 960/1938] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:51 2022] PUT /identity/v3/projects/39521e840ab849668922a636d7348eb9/users/2a1402ffc4ec4ec2bc1e197b79987595/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:52.118934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 979/1939] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:51 2022] DELETE /identity/v3/users/e80846172cf341df83ceb2f077bc90ed => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:52.128966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:52.129254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:52.129531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:52.158541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] MFA Rules not processed for user `2a1402ffc4ec4ec2bc1e197b79987595`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:52.159929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:52.235894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 961/1940] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:52.247281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:52.248677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:52.302976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45388e-1ce9-4e6b-9c98-041ab88939be admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:52.307120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:52.307774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:52.308050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:52.308323 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:52.316310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:52.317768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e38a-3ebf-4041-a7a7-953f092f558c service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:52.326221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 980/1941] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:52.619309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:52.621039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:52.686787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafda9e-5c71-403e-a712-914cd12f4acd None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:52.691610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:52.692465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:52.692746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:52.693020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] PATH_INFO: `/v3/projects/7e81fe7f290246a3929973e1fc72ddb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:52.694225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e81fe7f290246a3929973e1fc72ddb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:52.696974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:52.877240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e81fe7f290246a3929973e1fc72ddb1', 'request_id': 'req-588f3a3b-144d-4932-8941-e55a6f60cf06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:52.882402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e81fe7f290246a3929973e1fc72ddb1', 'request_id': 'req-588f3a3b-144d-4932-8941-e55a6f60cf06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:53.023192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e81fe7f290246a3929973e1fc72ddb1', 'request_id': 'req-588f3a3b-144d-4932-8941-e55a6f60cf06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:53.037247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] The token cache is being invalidate because project 7e81fe7f290246a3929973e1fc72ddb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:53.037532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:53.038213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-588f3a3b-144d-4932-8941-e55a6f60cf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:53.043853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 962/1942] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:52 2022] DELETE /identity/v3/projects/7e81fe7f290246a3929973e1fc72ddb1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:31:53.046109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.046473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.046857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.065444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:53.066765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:53.163160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 981/1943] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:53.164912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.165203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.165484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.194976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:53.196781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:53.205173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 963/1944] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:53.209411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.219465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb394b1-d832-4f89-8603-6d6b961a2b78 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.223975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.224620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.224897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.225168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.225979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:31:53.226278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.228416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.240181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 982/1945] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:31:53.244944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.254679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1547f-c95a-4996-8009-d7deb809aaa7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.259554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.260203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.260483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.260753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.261440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.263393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.345284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 964/1946] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:53.349611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.359985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b838-347d-4fad-8708-130ad9aec86e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.413026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.413697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.413987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.414256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.414939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.417489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.508261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 983/1947] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:53.512378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.522420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e365-8228-4690-af7e-0a9261739b87 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.527622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.528297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.528610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.528883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.529594 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.531349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.542115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 965/1948] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:53.546061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.555637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b2a-86ee-4b28-8026-87fe5c7532ce admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.560283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.560973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.571445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.571445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.571445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.571445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dffb8-3289-45e6-bc40-1b19a60e41ff admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.573869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 984/1949] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:53.579075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.589336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc247a-6fd3-4e6e-a62c-9b0d8e454257 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.593915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.594774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.595052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.595324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] PATH_INFO: `/v3/projects/a7bb85ef21e7443bbe5f32f9a6c91d34/users/f1b492ca2cd2428f9377d0b02bf2a072/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.609640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bb85ef21e7443bbe5f32f9a6c91d34, user_id=f1b492ca2cd2428f9377d0b02bf2a072, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.612318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.703353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 966/1950] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:53 2022] PUT /identity/v3/projects/a7bb85ef21e7443bbe5f32f9a6c91d34/users/f1b492ca2cd2428f9377d0b02bf2a072/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:53.714229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.714519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.714797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.740531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] MFA Rules not processed for user `f1b492ca2cd2428f9377d0b02bf2a072`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:53.741837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:53.802943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 985/1951] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:53.807401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.867043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020227d-ccb3-4540-b738-54c0b2d93ff2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:53.871702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:53.872351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:53.872638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:53.872916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:53.873588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:53.875532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:53.955159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 967/1952] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:31:53.959233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:53.970870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6c88-cbe3-4dec-8c29-7c7394262835 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.024166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.024840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.025800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.026081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.026765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.028743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.114915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 986/1953] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:31:53 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:31:54.119480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:54.130118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fda59-c33b-40b5-b30e-fb5dc3cd170b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.142145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.142823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.143108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.143379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.144159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.145840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.157716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 968/1954] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:31:54.161710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:54.171770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b767-c5f8-4875-9c3c-909704868d7b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.177296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.178287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.178632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.178971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] PATH_INFO: `/v3/projects/3e69810dfa5143469f1888c3aa37643c/users/9ef7eb3fd1e0446981b7808393fd8ae9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.207777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e69810dfa5143469f1888c3aa37643c, user_id=9ef7eb3fd1e0446981b7808393fd8ae9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.210490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.269008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 987/1955] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:54 2022] PUT /identity/v3/projects/3e69810dfa5143469f1888c3aa37643c/users/9ef7eb3fd1e0446981b7808393fd8ae9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:54.277504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:54.287571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce056abe-0d1c-4e4f-bdfd-4270e67b615c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.341890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.342538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.342818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.343088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.343788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.345370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e86021-32cc-45e5-aeac-d22ab884004e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.354680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 969/1956] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:31:54.358818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:54.369240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e4a1-50cf-4b41-bc61-78ede86ec5f0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.373880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.374758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.375038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.375315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] PATH_INFO: `/v3/projects/3e69810dfa5143469f1888c3aa37643c/users/9ef7eb3fd1e0446981b7808393fd8ae9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.377270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e69810dfa5143469f1888c3aa37643c, user_id=9ef7eb3fd1e0446981b7808393fd8ae9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.379959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.390491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 988/1957] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:31:54 2022] PUT /identity/v3/projects/3e69810dfa5143469f1888c3aa37643c/users/9ef7eb3fd1e0446981b7808393fd8ae9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:54.401004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837bd-f102-40bf-b861-8288e49a15d5 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.401291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837bd-f102-40bf-b861-8288e49a15d5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.401566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837bd-f102-40bf-b861-8288e49a15d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.427093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-98b837bd-f102-40bf-b861-8288e49a15d5 None None] MFA Rules not processed for user `9ef7eb3fd1e0446981b7808393fd8ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:54.428284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-98b837bd-f102-40bf-b861-8288e49a15d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:54.492365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 970/1958] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:54.503402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:54.505078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:54.560174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01480bee-6e6a-436d-96cd-899f54586a6a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:54.563912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:54.564547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:54.564823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:54.565089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:54.574108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:54.575539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:54.584778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 989/1959] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:56.402049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbcbf-9bbb-49a6-9497-06253fc1ee16 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:56.402951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbcbf-9bbb-49a6-9497-06253fc1ee16 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:56.403420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbcbf-9bbb-49a6-9497-06253fc1ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:56.425336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0a6fbcbf-9bbb-49a6-9497-06253fc1ee16 None None] MFA Rules not processed for user `2a1402ffc4ec4ec2bc1e197b79987595`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:56.426667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0a6fbcbf-9bbb-49a6-9497-06253fc1ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:56.489843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 971/1960] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:31:58.403987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:58.467082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74f0d-69dd-407e-8ea7-bedcddfd4409 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:58.470694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:58.471554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:58.471832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:58.472105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] PATH_INFO: `/v3/users/f1b492ca2cd2428f9377d0b02bf2a072` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:58.473300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b492ca2cd2428f9377d0b02bf2a072)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:58.475249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:58.898920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b492ca2cd2428f9377d0b02bf2a072'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:58.906851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b492ca2cd2428f9377d0b02bf2a072'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:58.918845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b492ca2cd2428f9377d0b02bf2a072'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:58.919651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b492ca2cd2428f9377d0b02bf2a072'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:58.995412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b492ca2cd2428f9377d0b02bf2a072'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.004272 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 990/1961] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:58 2022] DELETE /identity/v3/users/f1b492ca2cd2428f9377d0b02bf2a072 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:59.008824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:59.009550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:59.009550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:59.033613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:31:59.035091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:59.095404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 972/1962] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:31:59.105434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:59.107040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:59.163277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960991e2-fd4e-4b29-90a6-c01f8390f96e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:59.167936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:59.168578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:59.168856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:59.169136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:59.180648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:59.181175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:59.191474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 991/1963] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:31:59.612850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:59.614286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:31:59.626078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfaf1-d4c8-4ee8-9fad-fc893830dc73 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:59.630969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:59.631872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:59.632220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:59.632552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] PATH_INFO: `/v3/projects/a7bb85ef21e7443bbe5f32f9a6c91d34` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:59.633738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bb85ef21e7443bbe5f32f9a6c91d34)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:59.635655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:31:59.755527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bb85ef21e7443bbe5f32f9a6c91d34', 'request_id': 'req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.761208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bb85ef21e7443bbe5f32f9a6c91d34', 'request_id': 'req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.834616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bb85ef21e7443bbe5f32f9a6c91d34', 'request_id': 'req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.846931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] The token cache is being invalidate because project a7bb85ef21e7443bbe5f32f9a6c91d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:31:59.847215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.847861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:31:59.849380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 973/1964] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:31:59 2022] DELETE /identity/v3/projects/a7bb85ef21e7443bbe5f32f9a6c91d34 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:31:59.853456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:31:59.863804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561100c-7e31-4020-8c30-06eb525c96da service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:31:59.919412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:31:59.920309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:31:59.920606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:31:59.920874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] PATH_INFO: `/v3/users/9ef7eb3fd1e0446981b7808393fd8ae9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:31:59.922114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef7eb3fd1e0446981b7808393fd8ae9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:31:59.924027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:00.162944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef7eb3fd1e0446981b7808393fd8ae9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.170048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef7eb3fd1e0446981b7808393fd8ae9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.181861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef7eb3fd1e0446981b7808393fd8ae9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.185164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef7eb3fd1e0446981b7808393fd8ae9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.268654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44bf6d57-b114-40e0-aba2-768f4e4ecca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef7eb3fd1e0446981b7808393fd8ae9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.275843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 992/1965] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:31:59 2022] DELETE /identity/v3/users/9ef7eb3fd1e0446981b7808393fd8ae9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:00.768437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:00.769442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:00.790062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1de8-d0d3-4c03-a2dd-3c9dd67be607 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:00.848194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:00.849044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:00.849321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:00.849592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] PATH_INFO: `/v3/projects/3e69810dfa5143469f1888c3aa37643c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:00.850952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e69810dfa5143469f1888c3aa37643c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:00.852853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:00.968659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e69810dfa5143469f1888c3aa37643c', 'request_id': 'req-3e2f11ff-7120-4812-a2c4-d9201323e28f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:00.974369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e69810dfa5143469f1888c3aa37643c', 'request_id': 'req-3e2f11ff-7120-4812-a2c4-d9201323e28f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:01.052198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e69810dfa5143469f1888c3aa37643c', 'request_id': 'req-3e2f11ff-7120-4812-a2c4-d9201323e28f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:01.063897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] The token cache is being invalidate because project 3e69810dfa5143469f1888c3aa37643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:01.064401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:01.065040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3e2f11ff-7120-4812-a2c4-d9201323e28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:01.066629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 974/1966] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:00 2022] DELETE /identity/v3/projects/3e69810dfa5143469f1888c3aa37643c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:01.071712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.072217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.072309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.091177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:01.092386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:01.158798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 993/1967] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:01.166834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.167250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.176603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.188980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:01.190563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:01.201013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 975/1968] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:01.205358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.221106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d5c31-b80a-42fa-a53a-bf536dd91f67 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.227501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.228200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.228484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.228759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.229775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:01.229918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.231681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.250387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 994/1969] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:01.251747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.267418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e8db-c7e0-4023-a132-a8192c95b15e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.272533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.273413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.273825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.274294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.275115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.277882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.414434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 976/1970] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:01.418257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.428464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3d89-996c-40bc-bd45-a6e47c67eb04 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.497181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.498438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.498787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.499134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.499905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.502482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.587177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 995/1971] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:01.591175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.624269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0146b7d-5ddc-47ca-ae78-fc563d8577c0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.640657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.641950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.642459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.643005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.644087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.646513 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.665934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 977/1972] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:01.667722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.686936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd92a-36d7-4970-bb86-4728adeb8e09 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.693212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.693921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.694209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.694484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.695206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.696917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7e2f-fb99-4acb-a92f-85085c77ae7b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.710308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 996/1973] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:01.715369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:01.727650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f76c8-60bd-4528-98a2-1b8c9bd7eb34 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:01.735632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:01.736659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.737102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.737372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] PATH_INFO: `/v3/projects/57e322f7971d43b2803f1ca0b01dc4ca/users/fc4a2ae2ae3f48a48e4a474ef85f06d9/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.755522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e322f7971d43b2803f1ca0b01dc4ca, user_id=fc4a2ae2ae3f48a48e4a474ef85f06d9, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:01.758607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:01.852126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 978/1974] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:01 2022] PUT /identity/v3/projects/57e322f7971d43b2803f1ca0b01dc4ca/users/fc4a2ae2ae3f48a48e4a474ef85f06d9/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:01.864094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:01.864494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:01.864770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:01.892998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] MFA Rules not processed for user `fc4a2ae2ae3f48a48e4a474ef85f06d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:01.893917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:01.957172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 997/1975] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:01.961817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.031526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d6405-e748-433e-a231-7b8af560b6f2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.037246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.038254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.038779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.039307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.040877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.044329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.154498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 979/1976] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:02.155449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.169989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a9bd-872d-4eed-a3d9-a9a1145f13b5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.239837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.240539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.240848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.241096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.241975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.243916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.364433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 998/1977] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:02 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:02.368681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.379353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bca0b-d003-4e89-aff3-493d58f9561f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.384563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.386673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.387198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.387634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.388458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.390799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.412438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 980/1978] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:02.416699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.428068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85950e-03d9-4206-b332-65ad75f66d93 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.433747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.435031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.435480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.437571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] PATH_INFO: `/v3/projects/0794ca3955414417b64d176edd2073e2/users/2a232e4cb799452c91bd7fb9abbbe566/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.459877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0794ca3955414417b64d176edd2073e2, user_id=2a232e4cb799452c91bd7fb9abbbe566, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.464062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.547762 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 999/1979] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:02 2022] PUT /identity/v3/projects/0794ca3955414417b64d176edd2073e2/users/2a232e4cb799452c91bd7fb9abbbe566/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:02.548342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.563750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc786497-f6e8-4c00-babe-ee60c6dbbf7f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.673108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.676851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.676851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.676851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.676851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.678299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.685966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.688497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:02.708301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 981/1980] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:02.709457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.719041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49178-f79b-4b64-91ea-7da883703666 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.726075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.727681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.727848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327f65-cd01-413a-927f-ab3d8c4794dd admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:02.728315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.728768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] PATH_INFO: `/v3/users/8fbb4f0043b849bf82d558df3c710587` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.730499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbb4f0043b849bf82d558df3c710587)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.733082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.739835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:02.750328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.750328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.750328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] PATH_INFO: `/v3/projects/0794ca3955414417b64d176edd2073e2/users/2a232e4cb799452c91bd7fb9abbbe566/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.750328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0794ca3955414417b64d176edd2073e2, user_id=2a232e4cb799452c91bd7fb9abbbe566, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:02.753340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec1260-d02c-4a9c-b33e-b771102b3392 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:02.770363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 982/1981] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:02 2022] PUT /identity/v3/projects/0794ca3955414417b64d176edd2073e2/users/2a232e4cb799452c91bd7fb9abbbe566/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:02.787334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:02.787895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:02.788180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:02.843021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] MFA Rules not processed for user `2a232e4cb799452c91bd7fb9abbbe566`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:02.844246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:02.924414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbb4f0043b849bf82d558df3c710587'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:02.936611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 983/1982] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:02.952802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:02.960414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbb4f0043b849bf82d558df3c710587'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:02.961153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.002229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbb4f0043b849bf82d558df3c710587'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.004301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbb4f0043b849bf82d558df3c710587'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.049006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e23d0-d064-40b8-bc0e-a6b981ddb03d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:03.052968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:03.053851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.054342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.055142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.056654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.074923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7d12e250-3905-475c-9224-562084c05ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbb4f0043b849bf82d558df3c710587'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.082264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1000/1983] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:02 2022] DELETE /identity/v3/users/8fbb4f0043b849bf82d558df3c710587 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:03.087402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.087699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.088306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.118093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:03.119313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.123533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:03.125046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:03.134770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 984/1984] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:03.181276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1001/1985] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:03.190572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:03.192795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.258810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894fce6-03e2-4067-89db-478ce317ac68 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:03.316984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:03.317634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.317965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.318260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.329480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:03.336344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:03.354221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 985/1986] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:03.604111 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:03.605790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.617858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b904ec-843f-4c70-8741-c39cfc971e5b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:03.622661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:03.623601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.623888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.624164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] PATH_INFO: `/v3/users/226f9879476a4da3b9d233fb9b9ed611` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.625374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=226f9879476a4da3b9d233fb9b9ed611)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:03.627409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:03.738147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:03.740256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:03.756043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183afa6-de89-4776-a3c3-2610a0469f82 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:03.762871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:03.766577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.766577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.766577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] PATH_INFO: `/v3/projects/46506a8e438d4737a1ca44d48731df78` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.766577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46506a8e438d4737a1ca44d48731df78)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:03.767844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:03.836743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226f9879476a4da3b9d233fb9b9ed611'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.843645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226f9879476a4da3b9d233fb9b9ed611'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.855224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226f9879476a4da3b9d233fb9b9ed611'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.858509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226f9879476a4da3b9d233fb9b9ed611'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.894627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46506a8e438d4737a1ca44d48731df78', 'request_id': 'req-d782ee51-f209-4388-a951-0970ab020cdd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.900281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46506a8e438d4737a1ca44d48731df78', 'request_id': 'req-d782ee51-f209-4388-a951-0970ab020cdd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.937563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f76869e2-9c9e-4278-b9f4-f39f129c2bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226f9879476a4da3b9d233fb9b9ed611'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:03.944232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1002/1987] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:03 2022] DELETE /identity/v3/users/226f9879476a4da3b9d233fb9b9ed611 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:03.948775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:03.949019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:03.949339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:03.968414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:03.969614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.033458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1003/1988] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:04.039881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46506a8e438d4737a1ca44d48731df78', 'request_id': 'req-d782ee51-f209-4388-a951-0970ab020cdd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.040363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.041640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.052954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] The token cache is being invalidate because project 46506a8e438d4737a1ca44d48731df78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:04.053254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.053929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d782ee51-f209-4388-a951-0970ab020cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.055870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 986/1989] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:03 2022] DELETE /identity/v3/projects/46506a8e438d4737a1ca44d48731df78 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:04.068200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6c64-84a7-474f-8b15-577745630858 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.068553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6c64-84a7-474f-8b15-577745630858 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.069020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6c64-84a7-474f-8b15-577745630858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.088833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-596b6c64-84a7-474f-8b15-577745630858 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:04.090626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-596b6c64-84a7-474f-8b15-577745630858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.101214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 987/1990] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:04.103203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cee0ee-7cc5-4109-81d4-0cb3251a6336 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.111165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.111459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.111735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.112274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.113049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.113334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.113724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.115801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.136859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.138919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.142888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:04.144263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.153756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1004/1991] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:04.179054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 988/1992] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:04.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924becf-3f82-45d6-87db-269921d578ef service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.210862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.210862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.210862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:04.210862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.211113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.226986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1005/1993] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:04.231946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.243366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bbf41-2c3a-4d88-9163-3176b1f74700 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.249383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.250270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.250732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.251009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.252019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.254190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.367478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 989/1994] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:04.371423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.381088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c921d-9af8-4fbd-8763-8e993acdcc57 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.439945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.440769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.441054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.441327 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.442044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.444844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.505878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1006/1995] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:04 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:04.507658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.519089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5352-721c-40e8-8a70-2b92f7dab18a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.523910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.524689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.525006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.525355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.526227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.527979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.538457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 990/1996] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:04.542810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.552749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d01d8-96cf-48df-a6ef-d742e3ad5243 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.557415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.558646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.558926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.559196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.559958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.561623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.571176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1007/1997] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:04.580142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.585701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a075-9a6e-4048-bbd9-a589a095748c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.590643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.591552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.591876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.592145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] PATH_INFO: `/v3/projects/e5569a8c14dc480581aed3297db097c7/users/5cedbb7fa73747bbb6c278018c06038b/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.606209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.608786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.612560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5569a8c14dc480581aed3297db097c7, user_id=5cedbb7fa73747bbb6c278018c06038b, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.616000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f1fe-d431-4389-a6a7-1f7cee2cf5a6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.622898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3b41-fdf9-4d77-a6af-624336f3f7e0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.627742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.628597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.628879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.629149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] PATH_INFO: `/v3/projects/4a092ac14de8484c81bb41d893cd22ec` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.630335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a092ac14de8484c81bb41d893cd22ec)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:04.632253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:04.686451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 991/1998] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:04 2022] PUT /identity/v3/projects/e5569a8c14dc480581aed3297db097c7/users/5cedbb7fa73747bbb6c278018c06038b/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:04.696542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.696831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.697106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.722872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] MFA Rules not processed for user `5cedbb7fa73747bbb6c278018c06038b`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:04.725298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.786097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 992/1999] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:04.797006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.798487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.812870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a092ac14de8484c81bb41d893cd22ec', 'request_id': 'req-3faf257e-af08-4739-a7ba-85720531be70'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.818501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a092ac14de8484c81bb41d893cd22ec', 'request_id': 'req-3faf257e-af08-4739-a7ba-85720531be70'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.826165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a092ac14de8484c81bb41d893cd22ec', 'request_id': 'req-3faf257e-af08-4739-a7ba-85720531be70'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.861724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16d85-7eb7-4b3f-98d7-8a27035c48e7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:04.901151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] The token cache is being invalidate because project 4a092ac14de8484c81bb41d893cd22ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:04.904039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.904039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:04.907276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1008/2000] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:04 2022] DELETE /identity/v3/projects/4a092ac14de8484c81bb41d893cd22ec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:04.911791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:04.913460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.916269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:04.917150 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:04.917549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:04.917950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:04.920219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:04.999219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:05.000768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:05.010132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 993/2001] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:05.011564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf257e-af08-4739-a7ba-85720531be70 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:05.016192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:05.017051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:05.017328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:05.017597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] PATH_INFO: `/v3/users/7ae23a8623b74098beb8f06b23dfe3f9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:05.018850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae23a8623b74098beb8f06b23dfe3f9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:05.020753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:05.207479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae23a8623b74098beb8f06b23dfe3f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.214588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae23a8623b74098beb8f06b23dfe3f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.226036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae23a8623b74098beb8f06b23dfe3f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.226731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae23a8623b74098beb8f06b23dfe3f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.262578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-b15ef808-f8b6-4d46-96ce-ce256b150878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae23a8623b74098beb8f06b23dfe3f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.271712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1009/2002] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:04 2022] DELETE /identity/v3/users/7ae23a8623b74098beb8f06b23dfe3f9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:05.728438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:05.753221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d9a1-3c26-45c3-9f66-c797ab676245 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:05.810369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:05.811205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:05.811485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:05.811756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] PATH_INFO: `/v3/projects/eb50c7cb1eb448c2a02152919502623d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:05.812903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb50c7cb1eb448c2a02152919502623d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:05.814838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:05.980662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb50c7cb1eb448c2a02152919502623d', 'request_id': 'req-96a63f49-5dce-46e6-9a7d-a4ee89df662f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:05.986377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb50c7cb1eb448c2a02152919502623d', 'request_id': 'req-96a63f49-5dce-46e6-9a7d-a4ee89df662f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:06.039463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb50c7cb1eb448c2a02152919502623d', 'request_id': 'req-96a63f49-5dce-46e6-9a7d-a4ee89df662f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:06.051162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] The token cache is being invalidate because project eb50c7cb1eb448c2a02152919502623d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:06.053634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:06.053634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-96a63f49-5dce-46e6-9a7d-a4ee89df662f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:06.053841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 994/2003] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:05 2022] DELETE /identity/v3/projects/eb50c7cb1eb448c2a02152919502623d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:06.059238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.059589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.059876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.077767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:06.078987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:06.137355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1010/2004] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:06.145210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.145997 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.146287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.164670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:06.165916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:06.173820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 995/2005] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:06.177902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.187861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dc894-e6d6-4586-b345-365e775a19ca None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.192285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.192925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.193205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.193474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.194244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:06.194544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.196148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.207825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1011/2006] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:06.212300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.221403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04817bd4-b286-4d02-aade-c07e49c6208f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.225923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.226560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.226841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.227106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.227786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.229682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.344978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 996/2007] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:06.349157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.359576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c778-7163-4446-8381-f95468b3518c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.413712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.414394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.414675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.414946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.415616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.418086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.491818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1012/2008] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:06.496758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.507352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44465c2-abbe-458a-acb7-76aa2ba8aef3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.512110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.512764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.513083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.513357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.514106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.515703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.526093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 997/2009] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:06.530227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.540161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7139-3d89-42fe-b509-00990cbc4ab1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.545470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.546171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.546449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.546743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.547979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.550293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcdc91-7728-4082-80e9-d42baf7ef2b2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.561375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1013/2010] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:06.565559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.575849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a760c-d655-4f11-bf9c-3d671052e1a4 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.580590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.581498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.581821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.582100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] PATH_INFO: `/v3/projects/e34d23c616cf4344ad3390e87d9354d3/users/57b8c31b15c54913b9ac78b7948bb24f/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.597229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34d23c616cf4344ad3390e87d9354d3, user_id=57b8c31b15c54913b9ac78b7948bb24f, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.600033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.674619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 998/2011] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:06 2022] PUT /identity/v3/projects/e34d23c616cf4344ad3390e87d9354d3/users/57b8c31b15c54913b9ac78b7948bb24f/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:06.686457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deb60e-257f-4631-9335-e8dea243638f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.686816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deb60e-257f-4631-9335-e8dea243638f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.687159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deb60e-257f-4631-9335-e8dea243638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.718496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-80deb60e-257f-4631-9335-e8dea243638f None None] MFA Rules not processed for user `57b8c31b15c54913b9ac78b7948bb24f`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:06.719734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-80deb60e-257f-4631-9335-e8dea243638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:06.782045 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1014/2012] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:06.786647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.845977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94546dd-27a7-420c-a4af-9277f2655c57 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.850529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.851209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.851492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.851770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.852454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.854418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:06.924802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 999/2013] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:06.926200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deb60e-257f-4631-9335-e8dea243638f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:06.936700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deb60e-257f-4631-9335-e8dea243638f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:06.991522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:06.992503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:06.992787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:06.993060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:06.993778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:06.995751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.068355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1015/2014] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:06 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:07.072393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.082797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137e6e-b812-4006-ad7a-abe8b2fc1283 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.087695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.088341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.088624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.089389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.090198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.091779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.101878 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1000/2015] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:07.106151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.115961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d1342-c9df-44ae-9424-43380741016b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.120628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.121267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.121551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.121854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.122569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.124155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75902d1-1c3c-40a5-b8af-038f36ce4851 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.133721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1016/2016] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:07.138036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.147534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769ba-1c5b-41bf-bafe-414910851f57 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.152713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.153562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.153872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.154141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] PATH_INFO: `/v3/projects/25330a13fc9c4a549197f859a27da6d8/users/a1c21f9f0510454fab02476059c41f51/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.167751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25330a13fc9c4a549197f859a27da6d8, user_id=a1c21f9f0510454fab02476059c41f51, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.170428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.235706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1001/2017] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:07 2022] PUT /identity/v3/projects/25330a13fc9c4a549197f859a27da6d8/users/a1c21f9f0510454fab02476059c41f51/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:07.248729 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.249118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.249504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.276378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] MFA Rules not processed for user `a1c21f9f0510454fab02476059c41f51`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:07.277771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:07.340592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1017/2018] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:07.345062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.404501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07cd6-f14e-4794-9c2a-6983301018f3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.409023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.409681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.409975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.410244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.410904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.412797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.550283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1002/2019] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:07.554336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.564792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d7231-a587-434e-a39a-1662940bd998 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.618980 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.619425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.619709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.619986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.620678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.622663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.733306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1018/2020] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:07 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:07.737107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.753313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8304fb-2309-4d9e-bd74-e1e982bb67db admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.760439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.774661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.775271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1003/2021] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:07.779674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.789766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811768-1c1d-4007-a136-f505a8965da5 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.795053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.795925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.796207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.796483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] PATH_INFO: `/v3/projects/6a2589fdfd414d3e8deb5552ead338a0/users/9407cc68e37343d480087b708094c738/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.810954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2589fdfd414d3e8deb5552ead338a0, user_id=9407cc68e37343d480087b708094c738, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.813636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.891523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1019/2022] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:07 2022] PUT /identity/v3/projects/6a2589fdfd414d3e8deb5552ead338a0/users/9407cc68e37343d480087b708094c738/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:07.895526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.905853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10644e-428b-4ce1-a09a-0254fc58aeb0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.960477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.962067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.962067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.962067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.962785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:07.965070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0af2b0-68bc-411b-9c92-fcfe9c4d3902 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:07.977480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1004/2023] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:07.979583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:07.989590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc897b8-6de8-4a20-ad5f-8b06ebafbd38 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:07.994039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:07.994903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:07.995179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:07.995446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] PATH_INFO: `/v3/projects/6a2589fdfd414d3e8deb5552ead338a0/users/9407cc68e37343d480087b708094c738/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:07.997367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2589fdfd414d3e8deb5552ead338a0, user_id=9407cc68e37343d480087b708094c738, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:08.000052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:08.009834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1020/2024] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:07 2022] PUT /identity/v3/projects/6a2589fdfd414d3e8deb5552ead338a0/users/9407cc68e37343d480087b708094c738/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:08.021055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:08.021340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:08.021643 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:08.047410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] MFA Rules not processed for user `9407cc68e37343d480087b708094c738`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:08.048625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:08.118633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1005/2025] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:08.129499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:08.131242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:08.188812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010599a-7474-4886-99da-6156ee45ccde admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:08.192536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:08.193179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:08.193455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:08.193755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:08.203623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:08.205086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:08.215403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1021/2026] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:09.209744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:09.211170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:09.222897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00340-0705-44fd-838a-e0c9a992c0f1 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:09.226426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:09.227058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:09.227341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:09.227617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:09.282462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:09.283899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:09.292736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1006/2027] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:09.556504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:09.565896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1370f-dacd-4682-a8ae-faeb9028e3b9 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:09.569849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:09.570485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:09.575666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:09.575666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:09.575666 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:09.636669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:09.638168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:09.648700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1022/2028] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:10.953609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:10.955769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:11.033235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a41e-520c-48d2-8c6a-afd9048cc4eb service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:11.038287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:11.039244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:11.039534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:11.039808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] PATH_INFO: `/v3/users/88623315bbf84017879246b8b97134a6` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:11.041003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=88623315bbf84017879246b8b97134a6)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:11.043485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:11.208305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88623315bbf84017879246b8b97134a6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.223798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88623315bbf84017879246b8b97134a6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.308586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88623315bbf84017879246b8b97134a6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.331712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88623315bbf84017879246b8b97134a6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.332348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e93c8a8e-b911-46fe-8416-40036aa6c4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88623315bbf84017879246b8b97134a6'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.339558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1007/2029] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:10 2022] DELETE /identity/v3/users/88623315bbf84017879246b8b97134a6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:11.584192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:11.595956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8ceba-cc73-42da-8614-c8795fbe467e service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:11.651108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:11.652599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:11.652878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:11.653151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] PATH_INFO: `/v3/projects/0eebba0522ca4ad38c508481bc67b791` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:11.654348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eebba0522ca4ad38c508481bc67b791)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:11.656336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:11.811264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eebba0522ca4ad38c508481bc67b791', 'request_id': 'req-fe6fae3a-0417-4914-8654-552892322597'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.816527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eebba0522ca4ad38c508481bc67b791', 'request_id': 'req-fe6fae3a-0417-4914-8654-552892322597'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.822603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eebba0522ca4ad38c508481bc67b791', 'request_id': 'req-fe6fae3a-0417-4914-8654-552892322597'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.908351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] The token cache is being invalidate because project 0eebba0522ca4ad38c508481bc67b791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:11.908643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.909277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fe6fae3a-0417-4914-8654-552892322597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:11.911327 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1023/2030] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:11 2022] DELETE /identity/v3/projects/0eebba0522ca4ad38c508481bc67b791 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:11.915957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:11.916247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:11.916729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:11.934280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:11.935528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:11.995954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1008/2031] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:12.003783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.004102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.004384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.023734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:12.024937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:12.033320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1024/2032] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:12.037521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.047602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbf9f5-c3e3-407b-b123-4efcb392126b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.052183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.052836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.053120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.053399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.054145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:12.054452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.056039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.068177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1009/2033] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:12.071873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.081098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65d67-e949-4afe-be40-d1508b5ec1c0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.085744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.086388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.086926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.087202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.087905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.090391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.184154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1025/2034] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:12 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:12.188249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.198253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0077-405a-4a05-8b8b-ee664590bf71 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.252959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.253645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.253960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.254230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.254926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.256840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.337834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1010/2035] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:12 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:12.342890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.356154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc915e-ed17-49e9-bc0e-cac8bf4d02b7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.362463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.363249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.363594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.363922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.365258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.367413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.381829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1026/2036] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:12.386034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.401572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cd310-f959-4cd0-b722-c8ee2346869e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.404803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.405457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.405784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.406063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.406776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.408402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f024dc-7d47-4d14-8970-c730507687cd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.419093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1011/2037] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:12.423250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.434427 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eac7c-6c9d-425a-ba52-d0596c5a7729 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.438827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.439690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.439964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.440229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] PATH_INFO: `/v3/projects/680fe419d6a44ddcb8a1965b421ce8e9/users/bbc60b26fb424ad78dc6d86b5da15b0f/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.454461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680fe419d6a44ddcb8a1965b421ce8e9, user_id=bbc60b26fb424ad78dc6d86b5da15b0f, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.457115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.554829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1027/2038] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:12 2022] PUT /identity/v3/projects/680fe419d6a44ddcb8a1965b421ce8e9/users/bbc60b26fb424ad78dc6d86b5da15b0f/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:12.560530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.560820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.561095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.578647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:12.579859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:12.638408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1012/2039] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:12.647873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:12.649574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:12.704123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64cf9f-122c-48d4-b19f-783225e55733 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:12.707701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:12.708330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:12.708605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:12.708875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:12.718845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:12.720303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653540e-c281-4c4e-b53f-c0cffad2b4a9 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:12.730673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1028/2040] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:14.512780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:14.515677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:14.532295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc7c29-6187-4a5e-8030-6501f489beb6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:14.547907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:14.549007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:14.549389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:14.549786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] PATH_INFO: `/v3/users/5cedbb7fa73747bbb6c278018c06038b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:14.552908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cedbb7fa73747bbb6c278018c06038b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:14.556932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:14.874497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cedbb7fa73747bbb6c278018c06038b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:14.886690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cedbb7fa73747bbb6c278018c06038b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:14.998071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cedbb7fa73747bbb6c278018c06038b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:15.027462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cedbb7fa73747bbb6c278018c06038b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:15.028349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cedbb7fa73747bbb6c278018c06038b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:15.035825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1013/2041] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:14 2022] DELETE /identity/v3/users/5cedbb7fa73747bbb6c278018c06038b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:15.040520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620253-b945-4183-88f7-bfde96696e86 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:15.041468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620253-b945-4183-88f7-bfde96696e86 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:15.041788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620253-b945-4183-88f7-bfde96696e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:15.107075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-94620253-b945-4183-88f7-bfde96696e86 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:15.116292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-94620253-b945-4183-88f7-bfde96696e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:15.196634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1029/2042] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:15.207481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:15.209978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:15.277718 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f783c-5f14-4b18-9974-202fd804f704 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:15.285832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:15.287449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:15.288053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:15.288933 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:15.301474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:15.303102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61055c6-3c10-4f12-8202-beab8107c999 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:15.312942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1014/2043] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:15.877342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94620253-b945-4183-88f7-bfde96696e86 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:15.883352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-94620253-b945-4183-88f7-bfde96696e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:15.893256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94620253-b945-4183-88f7-bfde96696e86 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:15.900285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:15.901539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:15.902072 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:15.903169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] PATH_INFO: `/v3/projects/e5569a8c14dc480581aed3297db097c7` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:15.905683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5569a8c14dc480581aed3297db097c7)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:15.909622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.094142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5569a8c14dc480581aed3297db097c7', 'request_id': 'req-3046eff8-d54f-499d-8455-5987fe0a3f36'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:16.104263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5569a8c14dc480581aed3297db097c7', 'request_id': 'req-3046eff8-d54f-499d-8455-5987fe0a3f36'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:16.111724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5569a8c14dc480581aed3297db097c7', 'request_id': 'req-3046eff8-d54f-499d-8455-5987fe0a3f36'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:16.189421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] The token cache is being invalidate because project e5569a8c14dc480581aed3297db097c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:16.189656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:16.190791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3046eff8-d54f-499d-8455-5987fe0a3f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:16.193641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1030/2044] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:15 2022] DELETE /identity/v3/projects/e5569a8c14dc480581aed3297db097c7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:16.198741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.199833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.200358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.223469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:16.225089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:16.325832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1015/2045] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:16.328091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.328376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.328746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.368401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:16.372339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:16.385648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1031/2046] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:16.390378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.406504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855bec-0567-4b5d-ab2e-95f3fbd9f97c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.412937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.414024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.414452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.414869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.416029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:16.416499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:16.419476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.440319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1016/2047] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:16.444645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.459199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace38986-3929-4cb1-8b72-56d92c1b74f7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.468616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.470537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.471195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.471610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.472464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:16.475025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.593206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1032/2048] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:16 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:16.594835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.610191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6fa44-998e-4844-80a1-be19d8058077 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.684914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.685711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.686084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.686415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.687172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:16.689157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.775462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.778692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:16.805268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1017/2049] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:16 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:16.808089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.821425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e332d-34de-48b0-a236-e3c02a6d219f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.840300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.841084 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.848544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.848939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.850109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:16.851802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.867536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301654-aad5-4254-a020-f714ef5c8ba4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.873090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.873834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.874255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.874652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.877479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:16.877961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1018/2050] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:16.880275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.898388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8620c3-abd1-412b-9972-90dc3e637391 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.909417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.910148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.910428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.910700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.911431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:16.918876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:16.953401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1019/2051] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:16.959776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:16.978386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58dead-841c-4d45-b91c-c39944b77133 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:16.989616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:16.990547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:16.990825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:16.991095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] PATH_INFO: `/v3/projects/6a96671583c94c99a618651c99a5c458/users/d7cb2c883361432fae114d8271792433/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:16.999722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:17.001647 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6d5e5-bd85-43cb-af2f-9310359fa013 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:17.015747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1033/2052] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:17.035220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a96671583c94c99a618651c99a5c458, user_id=d7cb2c883361432fae114d8271792433, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:17.038396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:17.139078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1020/2053] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:16 2022] PUT /identity/v3/projects/6a96671583c94c99a618651c99a5c458/users/d7cb2c883361432fae114d8271792433/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:17.150371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0e8a-15bc-4b5c-bebe-4fa56d27fcf7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:17.150909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0e8a-15bc-4b5c-bebe-4fa56d27fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:17.151370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0e8a-15bc-4b5c-bebe-4fa56d27fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:17.188159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e5ec0e8a-15bc-4b5c-bebe-4fa56d27fcf7 None None] MFA Rules not processed for user `d7cb2c883361432fae114d8271792433`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:17.194889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e5ec0e8a-15bc-4b5c-bebe-4fa56d27fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:17.289948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1034/2054] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:17.312279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:17.315470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:17.406330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d38f-4a21-4165-bc7e-c36d48a157dd admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:17.410696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:17.411569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:17.412015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:17.412284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:17.423550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:17.425176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:17.436297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1021/2055] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:18.955915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4fab6-759f-46a8-b2af-9ccd4b844cf0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:18.956787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4fab6-759f-46a8-b2af-9ccd4b844cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:18.957417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4fab6-759f-46a8-b2af-9ccd4b844cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:18.997467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bbb4fab6-759f-46a8-b2af-9ccd4b844cf0 None None] MFA Rules not processed for user `bbc60b26fb424ad78dc6d86b5da15b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:18.998723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bbb4fab6-759f-46a8-b2af-9ccd4b844cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:19.066466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1035/2056] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:19.078667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:19.080213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:19.154902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5655a-5e7b-4247-baa1-309e0242898e service glance] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:19.161087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:19.162092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:19.162612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:19.162894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:19.172042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:19.173656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:19.183894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1022/2057] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:22.068657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c10e-b516-4296-bd7c-bbc1485b64e4 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:22.069226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c10e-b516-4296-bd7c-bbc1485b64e4 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:22.069436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c10e-b516-4296-bd7c-bbc1485b64e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:22.117052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b280c10e-b516-4296-bd7c-bbc1485b64e4 None None] MFA Rules not processed for user `bbc60b26fb424ad78dc6d86b5da15b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:22.119604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b280c10e-b516-4296-bd7c-bbc1485b64e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:22.143745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1036/2058] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:22.554587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:22.555984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:22.683822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d690-f696-4f70-96bc-91a9ad2ec958 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:22.689469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:22.690487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:22.691048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:22.691473 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] PATH_INFO: `/v3/users/57b8c31b15c54913b9ac78b7948bb24f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:22.693288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b8c31b15c54913b9ac78b7948bb24f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:22.695361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:22.940407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b8c31b15c54913b9ac78b7948bb24f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:22.951063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b8c31b15c54913b9ac78b7948bb24f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:23.057331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b8c31b15c54913b9ac78b7948bb24f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:23.077322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b8c31b15c54913b9ac78b7948bb24f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:23.078236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b8c31b15c54913b9ac78b7948bb24f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:23.085623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1023/2059] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:22 2022] DELETE /identity/v3/users/57b8c31b15c54913b9ac78b7948bb24f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:23.090466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:23.091038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:23.091038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:23.119239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:23.123254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:23.272571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1037/2060] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:23.281562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:23.283372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:23.390409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc92a-3082-43b2-aa8c-be021d90a6c1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:23.398438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:23.399117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:23.399402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:23.399673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:23.413790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:23.415867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:23.427405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1024/2061] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:23.916480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:23.918714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:23.935597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868168-f740-44fa-94bf-8d079c6f5067 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:23.940332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:23.941189 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:23.941559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:23.941822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] PATH_INFO: `/v3/projects/e34d23c616cf4344ad3390e87d9354d3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:23.943090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34d23c616cf4344ad3390e87d9354d3)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:23.945014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:24.048351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34d23c616cf4344ad3390e87d9354d3', 'request_id': 'req-6abe3128-529b-45f9-b862-f3cce76561d1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.055079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34d23c616cf4344ad3390e87d9354d3', 'request_id': 'req-6abe3128-529b-45f9-b862-f3cce76561d1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.061550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34d23c616cf4344ad3390e87d9354d3', 'request_id': 'req-6abe3128-529b-45f9-b862-f3cce76561d1'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.114682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] The token cache is being invalidate because project e34d23c616cf4344ad3390e87d9354d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:24.115295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.115768 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.120527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1038/2062] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:23 2022] DELETE /identity/v3/projects/e34d23c616cf4344ad3390e87d9354d3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:24.121511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:24.133590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ca76b-0f52-4f13-8701-12634d55b128 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:24.192423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:24.193402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:24.193592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:24.193929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] PATH_INFO: `/v3/users/a1c21f9f0510454fab02476059c41f51` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:24.195203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c21f9f0510454fab02476059c41f51)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:24.197294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:24.368248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c21f9f0510454fab02476059c41f51'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.375921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c21f9f0510454fab02476059c41f51'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.468489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c21f9f0510454fab02476059c41f51'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.488124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c21f9f0510454fab02476059c41f51'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.488900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c21f9f0510454fab02476059c41f51'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:24.495047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1025/2063] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:24 2022] DELETE /identity/v3/users/a1c21f9f0510454fab02476059c41f51 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:24.921842 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:24.923259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:24.936278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe3128-529b-45f9-b862-f3cce76561d1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:24.997198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:24.998090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:24.998376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:24.998650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] PATH_INFO: `/v3/projects/25330a13fc9c4a549197f859a27da6d8` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:24.999928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25330a13fc9c4a549197f859a27da6d8)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:25.001940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:25.165023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25330a13fc9c4a549197f859a27da6d8', 'request_id': 'req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.170401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25330a13fc9c4a549197f859a27da6d8', 'request_id': 'req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.176407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25330a13fc9c4a549197f859a27da6d8', 'request_id': 'req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.238715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] The token cache is being invalidate because project 25330a13fc9c4a549197f859a27da6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:25.238996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.239603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.241130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1039/2064] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:24 2022] DELETE /identity/v3/projects/25330a13fc9c4a549197f859a27da6d8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:25.245147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:25.246572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:25.258930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4e663-d5c2-4195-82ef-84430cc6ebe2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:25.314306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:25.315155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:25.315441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:25.315715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] PATH_INFO: `/v3/users/9407cc68e37343d480087b708094c738` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:25.316877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9407cc68e37343d480087b708094c738)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:25.318836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:25.481073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9407cc68e37343d480087b708094c738'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.487426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9407cc68e37343d480087b708094c738'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.599681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9407cc68e37343d480087b708094c738'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.611622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9407cc68e37343d480087b708094c738'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.612248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f0c554f4-ad72-4cb2-a4b1-4f1f707509cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9407cc68e37343d480087b708094c738'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:25.618045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1026/2065] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:25 2022] DELETE /identity/v3/users/9407cc68e37343d480087b708094c738 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:26.007440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.008874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:26.021795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bdb57-058a-4726-a286-7b1a3c54b5c8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.077588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.078474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.078752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.079025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] PATH_INFO: `/v3/projects/6a2589fdfd414d3e8deb5552ead338a0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.080212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2589fdfd414d3e8deb5552ead338a0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.082168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.203679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2589fdfd414d3e8deb5552ead338a0', 'request_id': 'req-a2c498e4-6a96-4646-8fed-b638626f46b8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:26.210292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2589fdfd414d3e8deb5552ead338a0', 'request_id': 'req-a2c498e4-6a96-4646-8fed-b638626f46b8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:26.217421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2589fdfd414d3e8deb5552ead338a0', 'request_id': 'req-a2c498e4-6a96-4646-8fed-b638626f46b8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:26.274520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] The token cache is being invalidate because project 6a2589fdfd414d3e8deb5552ead338a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:26.274733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:26.275367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a2c498e4-6a96-4646-8fed-b638626f46b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:26.277435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1040/2066] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:26 2022] DELETE /identity/v3/projects/6a2589fdfd414d3e8deb5552ead338a0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:26.283445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.283925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.284015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.302654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:26.303887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:26.368033 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1027/2067] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:26.376943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.377225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.377658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.396455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:26.397714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:26.407708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1041/2068] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:26.412270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.422888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d8a9b-d725-47d0-a573-3d259c591233 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.427425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.428071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.428347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.428615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.429329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:26.429655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.431287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.444217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1028/2069] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:32:26.449892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.461706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8ae9-f132-4d96-af27-f07106776b32 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.467902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.468573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.468856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.469129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.469882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.471800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.561697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1042/2070] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:26 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:26.565759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.576025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bddde0-e34b-443f-8aaa-8f5bf924c036 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.631913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.632572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.632848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.633125 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.633849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.635796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.715889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1029/2071] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:26 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:26.720015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.730719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b2b9-0f9e-452a-9dcd-fdec953a6078 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.736902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.737674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.737978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.738257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.739277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.740905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.753742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1043/2072] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:26.767517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.779148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c061b06-4426-401a-bd32-0e7a76a9c2b2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.789890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.790575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.790907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.791187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.792276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.794024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e609-7fe5-40d2-a986-f744e2cb6ac7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.816020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1030/2073] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:26.817535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:26.829183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b7e96-47fc-4984-8cc2-64787c792935 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:26.838076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:26.838076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.838076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.838076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] PATH_INFO: `/v3/projects/4059084dc89740bf932b08e6fc66fa49/users/4edef6ad4cb246b6bcb66adde29be2af/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.853618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4059084dc89740bf932b08e6fc66fa49, user_id=4edef6ad4cb246b6bcb66adde29be2af, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:26.856667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:26.939208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1044/2074] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:26 2022] PUT /identity/v3/projects/4059084dc89740bf932b08e6fc66fa49/users/4edef6ad4cb246b6bcb66adde29be2af/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:26.952061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b97d-1c78-4db2-be3f-9d9506af9fbb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:26.952399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b97d-1c78-4db2-be3f-9d9506af9fbb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:26.952623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b97d-1c78-4db2-be3f-9d9506af9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:26.984005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ba96b97d-1c78-4db2-be3f-9d9506af9fbb None None] MFA Rules not processed for user `4edef6ad4cb246b6bcb66adde29be2af`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:26.985255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ba96b97d-1c78-4db2-be3f-9d9506af9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:27.049962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1031/2075] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:27.062076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:27.063832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:27.129074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843289-2b50-4f45-b930-542a58c12b16 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:27.133357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:27.134405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:27.134681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:27.134949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:27.145074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:27.146617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:27.156168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1045/2076] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:28.364746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde5c2-aed9-4c02-879b-bd6a58787a89 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:28.365275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde5c2-aed9-4c02-879b-bd6a58787a89 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:28.365275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde5c2-aed9-4c02-879b-bd6a58787a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:28.385518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dbfde5c2-aed9-4c02-879b-bd6a58787a89 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:28.387982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dbfde5c2-aed9-4c02-879b-bd6a58787a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:28.458490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1032/2077] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:28.516807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:28.520543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:28.602393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4adba8-2951-4ff2-b96f-86e7ba33776b service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:28.612500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:28.612500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:28.612500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:28.612500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:28.622128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:28.624018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:28.633541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1046/2078] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:32:29.695078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7d81-d9c9-45bf-83db-bedc4c2ef9d9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:29.695532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7d81-d9c9-45bf-83db-bedc4c2ef9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:29.695757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7d81-d9c9-45bf-83db-bedc4c2ef9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:29.741799 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-233b7d81-d9c9-45bf-83db-bedc4c2ef9d9 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:29.743258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-233b7d81-d9c9-45bf-83db-bedc4c2ef9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:29.756584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1033/2079] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:32:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:29.773597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:29.779884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9ae-1ce4-464e-8c8d-65e2679ac3a1 service swift] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:29.784838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:29.785460 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:29.785773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:29.786046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:29.795990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:29.795990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:29.803766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1047/2080] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:32:30.422872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92026f-8727-41fe-ac5b-a4c2c28c60ad None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:30.423153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92026f-8727-41fe-ac5b-a4c2c28c60ad None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:30.423420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92026f-8727-41fe-ac5b-a4c2c28c60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:30.440749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-bb92026f-8727-41fe-ac5b-a4c2c28c60ad None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:30.441959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bb92026f-8727-41fe-ac5b-a4c2c28c60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:30.449578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1034/2081] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:32:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:30.461357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:30.472545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73764-9cc2-44b8-8e04-c6716da38589 service swift] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:30.477747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:30.478400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:30.478675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:30.478945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:30.486810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:30.488383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:30.496865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1048/2082] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:32:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:32:31.207572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:31.208022 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:31.208118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:31.227493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:31.228704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:31.235892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1035/2083] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:31.248032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:31.258700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84683-b594-455a-bb20-c8ae9b13dfb4 service swift] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:31.264099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:31.264720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:31.264996 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:31.265265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:31.272981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:31.274610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c163d-dacb-4725-ab04-6fdb638e8809 service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:31.283086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1049/2084] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 25 03:32:37.069673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:37.071052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:37.141756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f2f2c-282b-4d4c-b6a0-2dbbd7ec34fc None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:37.146269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:37.147168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:37.147444 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:37.147711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] PATH_INFO: `/v3/users/2a1402ffc4ec4ec2bc1e197b79987595` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:37.148875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1402ffc4ec4ec2bc1e197b79987595)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:37.150812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:37.408510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1402ffc4ec4ec2bc1e197b79987595'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:37.415561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1402ffc4ec4ec2bc1e197b79987595'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:37.514040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1402ffc4ec4ec2bc1e197b79987595'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:37.525896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1402ffc4ec4ec2bc1e197b79987595'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:37.526562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1402ffc4ec4ec2bc1e197b79987595'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:37.532723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1036/2085] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:37 2022] DELETE /identity/v3/users/2a1402ffc4ec4ec2bc1e197b79987595 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:37.537118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:37.537591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:37.537717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:37.554745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:37.555941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:37.612570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1050/2086] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:37.622238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:37.623632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:37.677798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13356d-1a8a-4963-9ef2-d127127f4713 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:37.681277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:37.681936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:37.682218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:37.682488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:37.691073 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:37.692492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181644-fa4a-4421-9b90-9e5069f7c763 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:37.702066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1037/2087] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:37.970603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:37.972379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:37.985484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5fd04-7221-490a-b916-c32e4cf8e353 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:37.990243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:37.991309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:37.991713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:37.992098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] PATH_INFO: `/v3/projects/39521e840ab849668922a636d7348eb9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:37.993512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39521e840ab849668922a636d7348eb9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:37.995991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.085285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39521e840ab849668922a636d7348eb9', 'request_id': 'req-3ad21825-4b8a-4f97-8955-f36ae31441c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:38.090872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39521e840ab849668922a636d7348eb9', 'request_id': 'req-3ad21825-4b8a-4f97-8955-f36ae31441c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:38.096852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39521e840ab849668922a636d7348eb9', 'request_id': 'req-3ad21825-4b8a-4f97-8955-f36ae31441c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:38.222357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] The token cache is being invalidate because project 39521e840ab849668922a636d7348eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:38.222719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:38.223409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ad21825-4b8a-4f97-8955-f36ae31441c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:38.225044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1051/2088] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:37 2022] DELETE /identity/v3/projects/39521e840ab849668922a636d7348eb9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:38.230372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.232463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.232463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.249557 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:38.251044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:38.315840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1038/2089] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:38.323477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.323767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.324042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.344355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:38.345560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:38.354396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1052/2090] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:38.359357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.369993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce8e3b-f1cf-40b7-8aae-b2a374dd94b2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.375941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.376349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.376876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.377157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.377914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:38.378218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.379806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.392129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1039/2091] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:38.396695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.406082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec1c15-9955-4bd4-a030-5350dbe22188 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.410804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.411631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.412070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.412346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.413109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.415069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.495037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1053/2092] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:38 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:38.500891 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.512241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e826-be77-4a52-9bd4-3ef1c19f3187 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.576989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.577808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.578089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.578363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.579031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.580947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.657322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1040/2093] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:38 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:38.661350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.672163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481e4d-b92b-4c51-a388-4f2b7e57b18d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.677086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.677785 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.678066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.678340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.679123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.680772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.691724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1054/2094] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:38.697086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.707887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040f57-c8a0-4864-86dd-84b354bdcd46 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.712914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.713560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.713890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.714147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.714849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.716430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f941-366c-4ad4-b37c-516cc22352ad admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.726069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1041/2095] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:38.730424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.740253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30a87-73bf-4208-bfa8-f5c923d40bd2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:38.744969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:38.747038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.747321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.747771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] PATH_INFO: `/v3/projects/a5185ed76d0a4079bda29a0cf1b3f428/users/1f0bf46ff1854167a61427a582b39ac6/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.763069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5185ed76d0a4079bda29a0cf1b3f428, user_id=1f0bf46ff1854167a61427a582b39ac6, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:38.765787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:38.885819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1055/2096] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:38 2022] PUT /identity/v3/projects/a5185ed76d0a4079bda29a0cf1b3f428/users/1f0bf46ff1854167a61427a582b39ac6/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:38.891972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:38.892388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:38.892669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:38.913609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:38.913609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:38.972569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1042/2097] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:38.983179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:38.985073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:39.044401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe71c3-0903-47a4-a296-fc8d2f3c0ec5 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:39.048241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:39.048904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:39.049177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:39.049753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:39.059365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:39.060818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2700-4c8e-4130-8300-89d1087ff10e service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:39.070682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1056/2098] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:39.415614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:39.415614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:39.423200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219680ca-a739-47bc-a373-96e7444fb61b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:39.427712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:39.428562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:39.428839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:39.429108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] PATH_INFO: `/v3/users/fc4a2ae2ae3f48a48e4a474ef85f06d9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:39.430381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4a2ae2ae3f48a48e4a474ef85f06d9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:39.432302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:39.668188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4a2ae2ae3f48a48e4a474ef85f06d9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:39.676070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4a2ae2ae3f48a48e4a474ef85f06d9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:39.759929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4a2ae2ae3f48a48e4a474ef85f06d9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:39.773519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4a2ae2ae3f48a48e4a474ef85f06d9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:39.774205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4a2ae2ae3f48a48e4a474ef85f06d9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:39.780714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1043/2099] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:39 2022] DELETE /identity/v3/users/fc4a2ae2ae3f48a48e4a474ef85f06d9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:39.785178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c9a-1815-49e8-b4d4-8120906179d9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:39.785633 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c9a-1815-49e8-b4d4-8120906179d9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:39.788920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c9a-1815-49e8-b4d4-8120906179d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:39.802509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-292d3c9a-1815-49e8-b4d4-8120906179d9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:39.803808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-292d3c9a-1815-49e8-b4d4-8120906179d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:39.861917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1057/2100] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:39.871633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:39.873220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:39.931870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26094a-3440-4b5f-8214-a0e506ba0ff1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:39.936332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:39.936984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:39.937267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:39.937543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:39.948106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:39.950117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:39.960014 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1044/2101] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:40.351931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:40.352218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:40.352646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:40.384180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] MFA Rules not processed for user `1f0bf46ff1854167a61427a582b39ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:40.385380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.441609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:40.443790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.457484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1058/2102] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:40.462728 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:40.465392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.471051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750775d-df2d-47d3-a3f9-246e4276d73b service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:40.485917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:40.486401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee199-abd1-468b-8135-a05bbfc3f0b3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:40.488085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:40.488538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:40.488976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] PATH_INFO: `/v3/users/4edef6ad4cb246b6bcb66adde29be2af` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:40.490768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edef6ad4cb246b6bcb66adde29be2af)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:40.492292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:40.492292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:40.492541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:40.492811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] PATH_INFO: `/v3/projects/57e322f7971d43b2803f1ca0b01dc4ca` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:40.494492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e322f7971d43b2803f1ca0b01dc4ca)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:40.495199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:40.497034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:40.712794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edef6ad4cb246b6bcb66adde29be2af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.714534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e322f7971d43b2803f1ca0b01dc4ca', 'request_id': 'req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.720734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edef6ad4cb246b6bcb66adde29be2af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.721126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e322f7971d43b2803f1ca0b01dc4ca', 'request_id': 'req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.728564 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e322f7971d43b2803f1ca0b01dc4ca', 'request_id': 'req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.807342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edef6ad4cb246b6bcb66adde29be2af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.824154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edef6ad4cb246b6bcb66adde29be2af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.825160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edef6ad4cb246b6bcb66adde29be2af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.831425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1045/2103] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:40 2022] DELETE /identity/v3/users/4edef6ad4cb246b6bcb66adde29be2af => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:40.832310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:40.835026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.906237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4c26-905b-4f27-8476-c920a945562e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:40.909785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:40.910426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:40.910705 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:40.910974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:40.912743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.931014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] The token cache is being invalidate because project 57e322f7971d43b2803f1ca0b01dc4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:40.931499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.939438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4c56476-c25f-4943-b8c2-fc0b0a3e071f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:40.939438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1059/2104] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:40 2022] DELETE /identity/v3/projects/57e322f7971d43b2803f1ca0b01dc4ca => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:40.939438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:40.939438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:40.939438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:40.954723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:40.956358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:40.970272 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:40.972227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:40.981630 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1046/2105] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:40.982589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:40.983887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:41.021406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1060/2106] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:41.031916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:41.033712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:41.059568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c547735-6a41-4f66-a8c3-8182d3f56588 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:41.064504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:41.065445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:41.069920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:41.069920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] PATH_INFO: `/v3/users/2a232e4cb799452c91bd7fb9abbbe566` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:41.069920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a232e4cb799452c91bd7fb9abbbe566)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:41.069920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:41.119886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494827ad-907b-4687-9b11-4fcc6bab556b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:41.123597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:41.124245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:41.124539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:41.124841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:41.133868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:41.135302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:41.145720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1061/2107] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:41.258285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a232e4cb799452c91bd7fb9abbbe566'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.265171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a232e4cb799452c91bd7fb9abbbe566'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.365839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a232e4cb799452c91bd7fb9abbbe566'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.382917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a232e4cb799452c91bd7fb9abbbe566'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.383723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a232e4cb799452c91bd7fb9abbbe566'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.392185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1047/2108] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:40 2022] DELETE /identity/v3/users/2a232e4cb799452c91bd7fb9abbbe566 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:41.691070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:41.693225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:41.710690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae33f-e6e0-4824-9891-b7df793e0766 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:41.789413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:41.790313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:41.790600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:41.790871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] PATH_INFO: `/v3/projects/4059084dc89740bf932b08e6fc66fa49` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:41.792116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4059084dc89740bf932b08e6fc66fa49)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:41.794350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:41.899232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:41.900663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:41.913824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d460d-b215-4ce3-a5eb-72550fd0c41a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:41.918558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:41.919401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:41.919684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:41.919989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] PATH_INFO: `/v3/projects/0794ca3955414417b64d176edd2073e2` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:41.921860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0794ca3955414417b64d176edd2073e2)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:41.923844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:41.981389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4059084dc89740bf932b08e6fc66fa49', 'request_id': 'req-abe78987-f4be-41d8-8bab-29b67f4045a5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.988692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4059084dc89740bf932b08e6fc66fa49', 'request_id': 'req-abe78987-f4be-41d8-8bab-29b67f4045a5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:41.996130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4059084dc89740bf932b08e6fc66fa49', 'request_id': 'req-abe78987-f4be-41d8-8bab-29b67f4045a5'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.075547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0794ca3955414417b64d176edd2073e2', 'request_id': 'req-fdf78edb-00d5-4b99-b168-8972c5a67f06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.081077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0794ca3955414417b64d176edd2073e2', 'request_id': 'req-fdf78edb-00d5-4b99-b168-8972c5a67f06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.096777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] The token cache is being invalidate because project 4059084dc89740bf932b08e6fc66fa49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:42.097180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.097939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-abe78987-f4be-41d8-8bab-29b67f4045a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.099606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1062/2109] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:41 2022] DELETE /identity/v3/projects/4059084dc89740bf932b08e6fc66fa49 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:42.105394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77b8f-f5c2-4d68-897b-541631360df2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.105793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77b8f-f5c2-4d68-897b-541631360df2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.106147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77b8f-f5c2-4d68-897b-541631360df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.123804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5eb77b8f-f5c2-4d68-897b-541631360df2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:42.125004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5eb77b8f-f5c2-4d68-897b-541631360df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:42.171536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0794ca3955414417b64d176edd2073e2', 'request_id': 'req-fdf78edb-00d5-4b99-b168-8972c5a67f06'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.183285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] The token cache is being invalidate because project 0794ca3955414417b64d176edd2073e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:42.183574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.184214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fdf78edb-00d5-4b99-b168-8972c5a67f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:42.185707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1063/2110] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:42.185823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1048/2111] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:41 2022] DELETE /identity/v3/projects/0794ca3955414417b64d176edd2073e2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:32:42.189809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.190099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.190373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.190463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4eaf0-2b03-491b-a1d0-b959d33a6a25 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.190757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4eaf0-2b03-491b-a1d0-b959d33a6a25 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.191045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4eaf0-2b03-491b-a1d0-b959d33a6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.209640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1bc4eaf0-2b03-491b-a1d0-b959d33a6a25 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:42.210881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1bc4eaf0-2b03-491b-a1d0-b959d33a6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:42.212576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:42.213805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:42.219105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1049/2112] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:42.223223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1064/2113] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:42.226232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.226683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.227076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.227358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.236131 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bc16-6911-4452-9df6-69821446fc67 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.240808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.241449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.241786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.242060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.242775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:42.243105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.244796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.245876 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:42.247070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:42.255857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1050/2114] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:42.259638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1065/2115] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:42.260507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.261299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.271453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83804-a0e8-4758-b260-91185854cb24 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.271665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9eaec-ce40-4c08-9c7e-35420952ad44 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.277146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.277285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.277866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.278015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.278157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.278495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.278599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.279277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.279410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:42.279500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.279966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.281104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.282539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.297527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1051/2116] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:32:42.298510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.308983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa61815-6765-44a6-b572-11160f3ef25f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.314172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.314824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.315106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.315382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.316116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.318093 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.419170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1066/2117] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:42.423837 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.460178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1052/2118] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:42.465070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.486078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771a36f-43c3-4020-bc92-12733661d498 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.524182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d9314-286f-4b89-a8ab-b00e716efde1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.529449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.530143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.530423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.530692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.531366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.533283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.540289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.540984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.541262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.541574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.542366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.544446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.657523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1053/2119] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:42.661409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.671116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1173-181e-4d2e-b22d-980de5c46f55 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.676055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.676640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.676921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.677191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.677940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.679541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.691817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1054/2120] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:42.695981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.696904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1067/2121] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:42.701409 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.707747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1dc5-a955-404b-b737-f81d727832b8 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.713234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.713974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.714263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.714539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.715482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.717094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.717581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f40de-274c-4f38-a93a-dee68554832a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.723479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.724416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.725284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.725866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.726769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.728798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.731260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1055/2122] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:42.736411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.758646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1068/2123] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:42.761608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c013-dee8-4db7-804d-b34352728813 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.762595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.766959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.767993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.768333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.769744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] PATH_INFO: `/v3/projects/2ac8df7c9fa34c15b428c7067b02ff7a/users/514adb2a15f1468abc5be24fe12720ee/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.775604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988ead-be1b-4e4a-8d6b-e21ca1279b1e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.780753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.781520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.781842 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.782119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.782844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.784476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456406cf-faa1-4401-88c6-afc868f59b91 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.788312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac8df7c9fa34c15b428c7067b02ff7a, user_id=514adb2a15f1468abc5be24fe12720ee, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.791199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5afa0-d418-4b1a-9c78-0389eb882d65 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:42.800852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1069/2124] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:42.800852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.800852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.800852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.820431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] MFA Rules not processed for user `1f0bf46ff1854167a61427a582b39ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:42.821860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:42.875879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1070/2125] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:42.876681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:42.886954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c906a19-e318-48cc-9f0e-0db40c13aebf None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:42.891889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:42.892767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:42.893077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:42.893350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] PATH_INFO: `/v3/projects/58df856224c84d298865e9687aaaef2f/users/3efd0660386f44dbbc6f5f45f3ab63c9/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:42.907919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58df856224c84d298865e9687aaaef2f, user_id=3efd0660386f44dbbc6f5f45f3ab63c9, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:42.910673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0510d0-1298-4989-932b-fe41c011196f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.001284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1056/2126] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:42 2022] PUT /identity/v3/projects/2ac8df7c9fa34c15b428c7067b02ff7a/users/514adb2a15f1468abc5be24fe12720ee/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:43.011755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.012062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.012322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.038998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] MFA Rules not processed for user `514adb2a15f1468abc5be24fe12720ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:43.040199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:43.052121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1071/2127] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:42 2022] PUT /identity/v3/projects/58df856224c84d298865e9687aaaef2f/users/3efd0660386f44dbbc6f5f45f3ab63c9/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:43.062664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.063035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.063411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.094869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] MFA Rules not processed for user `3efd0660386f44dbbc6f5f45f3ab63c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:43.097173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:43.125079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1057/2128] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:43.126793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.185561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1072/2129] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:43.193519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.197404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:43.215710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def364ec-3bd0-47d7-b934-e8ad0984948c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.278382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.279314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.279747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.279898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b933-ef29-4480-816f-7c38deb397cc None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.280305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.281358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.283452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.289397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.291500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.292120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.292407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.316849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.316849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.324826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1073/2130] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:32:43.405928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1058/2131] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:43 2022] POST /identity/v3/projects => generated 387 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:43.407386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.420064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326639-a96f-4b80-a4ae-a1c0be53309e service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.480752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.481478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.481807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.482171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.482920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.485622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.598329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1074/2132] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:43 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:43.599545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.613161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21c30-10fa-48d8-8d37-8be4b52dd677 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.621008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.621008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.621213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.621475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.622220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.623829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.638832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1059/2133] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:43.639973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.650406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291458cb-dd81-41c6-8272-9e4a8627b64c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.656105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.657064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.657254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.657525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] PATH_INFO: `/v3/projects/5c88f2d762394f3db1c662dd5856521c/users/41ea5f3c778d4ab08a7576ee89a904e7/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.675599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c88f2d762394f3db1c662dd5856521c, user_id=41ea5f3c778d4ab08a7576ee89a904e7, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.678508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.790289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1075/2134] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:43 2022] PUT /identity/v3/projects/5c88f2d762394f3db1c662dd5856521c/users/41ea5f3c778d4ab08a7576ee89a904e7/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:43.794030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.804078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec127c2-60f6-4694-b2d8-c68bf9d98798 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.864154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.867170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.867170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.867170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.867170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.868641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cd89f-9220-4188-9ebd-06c55b292d3d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.883219 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1060/2135] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:32:43.884617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:43.896358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c14fa-d402-462b-91f1-102ce9cd90b4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:43.901094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:43.902736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.903018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.903416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] PATH_INFO: `/v3/projects/5c88f2d762394f3db1c662dd5856521c/users/41ea5f3c778d4ab08a7576ee89a904e7/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.905537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c88f2d762394f3db1c662dd5856521c, user_id=41ea5f3c778d4ab08a7576ee89a904e7, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:43.908368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:43.922522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1076/2136] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:43 2022] PUT /identity/v3/projects/5c88f2d762394f3db1c662dd5856521c/users/41ea5f3c778d4ab08a7576ee89a904e7/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:43.932186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:43.932480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:43.933318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:43.963527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] MFA Rules not processed for user `41ea5f3c778d4ab08a7576ee89a904e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:43.965397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:44.083506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1061/2137] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:44.092346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:44.153073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea936-eac6-4207-9128-9939bfb665da admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:44.156734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:44.157376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:44.157655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:44.157970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:44.168028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:44.169553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107b968-12eb-46c9-acaa-7d2b5ef17be5 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:44.179659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1077/2138] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:44.207415 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:44.271593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458f3e-3711-4cfb-b131-5148b90c6a82 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:44.283510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:44.283510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:44.283510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:44.283510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] PATH_INFO: `/v3/users/514adb2a15f1468abc5be24fe12720ee` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:44.284968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=514adb2a15f1468abc5be24fe12720ee)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:44.287360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:44.489114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514adb2a15f1468abc5be24fe12720ee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:44.496198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514adb2a15f1468abc5be24fe12720ee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:44.565845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514adb2a15f1468abc5be24fe12720ee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:44.578738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514adb2a15f1468abc5be24fe12720ee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:44.579406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514adb2a15f1468abc5be24fe12720ee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:44.585853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1062/2139] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:44 2022] DELETE /identity/v3/users/514adb2a15f1468abc5be24fe12720ee => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:44.591527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:44.591822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:44.592102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:44.609400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:44.610629 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:44.675260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1078/2140] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:44.685330 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:44.686762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:44.778530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ca602-fd59-400b-ad07-44f68922f21a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:44.782354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:44.783164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:44.783547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:44.784091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:44.794405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:44.796082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:44.806249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1063/2141] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:45.282299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:45.284630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:45.308616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af30ae-fa73-4a42-9860-ef3025271a5b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:45.313208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:45.314094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:45.314372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:45.314639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] PATH_INFO: `/v3/projects/2ac8df7c9fa34c15b428c7067b02ff7a` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:45.315854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac8df7c9fa34c15b428c7067b02ff7a)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:45.317842 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:45.462653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac8df7c9fa34c15b428c7067b02ff7a', 'request_id': 'req-d9915e1b-9666-461e-9ec5-00e51ff431a6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.469884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac8df7c9fa34c15b428c7067b02ff7a', 'request_id': 'req-d9915e1b-9666-461e-9ec5-00e51ff431a6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.476030 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac8df7c9fa34c15b428c7067b02ff7a', 'request_id': 'req-d9915e1b-9666-461e-9ec5-00e51ff431a6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.577024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] The token cache is being invalidate because project 2ac8df7c9fa34c15b428c7067b02ff7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:45.577392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.578114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.579717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1079/2142] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:45 2022] DELETE /identity/v3/projects/2ac8df7c9fa34c15b428c7067b02ff7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:45.589921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:45.600264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a52e06-1e87-4a3d-ad5f-d866237f7ef4 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:45.664785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:45.664785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:45.664785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:45.664785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] PATH_INFO: `/v3/users/41ea5f3c778d4ab08a7576ee89a904e7` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:45.665208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ea5f3c778d4ab08a7576ee89a904e7)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:45.665530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:45.916576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ea5f3c778d4ab08a7576ee89a904e7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:45.923454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ea5f3c778d4ab08a7576ee89a904e7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.023082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ea5f3c778d4ab08a7576ee89a904e7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.037541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ea5f3c778d4ab08a7576ee89a904e7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.038264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e5bf4e58-92b5-4b34-b6e7-3ca582809237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ea5f3c778d4ab08a7576ee89a904e7'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.044186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1064/2143] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:45 2022] DELETE /identity/v3/users/41ea5f3c778d4ab08a7576ee89a904e7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:46.566918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:46.568375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:46.581234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915e1b-9666-461e-9ec5-00e51ff431a6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:46.638669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:46.639521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:46.639799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:46.640069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] PATH_INFO: `/v3/projects/5c88f2d762394f3db1c662dd5856521c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:46.641232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c88f2d762394f3db1c662dd5856521c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:46.643204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:46.788130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c88f2d762394f3db1c662dd5856521c', 'request_id': 'req-5870d039-ea48-47eb-893e-74f412a38e8a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.793831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c88f2d762394f3db1c662dd5856521c', 'request_id': 'req-5870d039-ea48-47eb-893e-74f412a38e8a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.799852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c88f2d762394f3db1c662dd5856521c', 'request_id': 'req-5870d039-ea48-47eb-893e-74f412a38e8a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.896388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] The token cache is being invalidate because project 5c88f2d762394f3db1c662dd5856521c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:46.896695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.897332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-5870d039-ea48-47eb-893e-74f412a38e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:46.898971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1080/2144] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:46 2022] DELETE /identity/v3/projects/5c88f2d762394f3db1c662dd5856521c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:46.904424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:46.904910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:46.905000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:46.922789 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:46.923992 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:46.989757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1065/2145] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:46.992872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:46.993212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:46.993500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.011984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:47.013195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:47.021250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1081/2146] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:47.025624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.035909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eb86-d301-4701-bb7f-88a3a14fa680 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.040808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.041406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.041717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.042561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.043351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:47.043659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.045269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.058626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1066/2147] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:32:47.063829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.073570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46ddd-9bf2-4faa-a72d-8c8b767412cb None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.078489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.079984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.079984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.079984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.082737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.082737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.220297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1082/2148] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:47 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:47.221266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.244317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45162ec3-f56f-4c98-980e-14fe1c0bbd91 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.301853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.302433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.302715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.302987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.303664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.305587 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.412538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1067/2149] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:47 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:47.417183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.428328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e75ca6-b718-43f8-8479-57866f6816f4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.433497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.434277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.434561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.434832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.435545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.437330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.448748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1083/2150] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:47.452855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.463483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a54b1-c51f-43d8-a247-75bca89d8d0e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.469054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.469746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.470050 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.470311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.471045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.472636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca8518-7a5b-4268-a25e-d7c7150744ba admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.482537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1068/2151] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:47.486893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.496887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb448-ef18-4b67-a30c-60b897654abd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.502255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.503370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.503473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.503663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] PATH_INFO: `/v3/projects/eaca084d21214dcd8be6170bceae5359/users/f9e1dbe1b9cf4913a67208ae290329c8/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.519096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaca084d21214dcd8be6170bceae5359, user_id=f9e1dbe1b9cf4913a67208ae290329c8, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.521814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.591412 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1084/2152] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:47 2022] PUT /identity/v3/projects/eaca084d21214dcd8be6170bceae5359/users/f9e1dbe1b9cf4913a67208ae290329c8/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:47.594531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.594833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.595095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.624043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] MFA Rules not processed for user `f9e1dbe1b9cf4913a67208ae290329c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:47.625277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:47.696036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1069/2153] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:47.700324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.762923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8aa30-b42a-47d1-bf27-16c5e8bfd4f0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.770732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.770732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.770732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:47.770732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:47.771059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:47.772203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:47.907826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1085/2154] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:47 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:47.909076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:47.922310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99329f7-8a9b-43ec-8365-75919221afe0 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:47.999282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:47.999282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:47.999621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.000075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.000856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.002823 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.087674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1070/2155] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:47 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:48.092646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.104717 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c70b-3117-4494-816f-2836a7b7819b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.109875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.110563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.111078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.111513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.112246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.114192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.126251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1086/2156] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:48.131075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.143304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05937a-8f35-4738-9b3d-2b6c41559785 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.150037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.150939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.151846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.152126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] PATH_INFO: `/v3/projects/fabc90c5580d4017a5da8c5f293e437c/users/c8ddca77078e4d0fbde5687ef5dcac19/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.168603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc90c5580d4017a5da8c5f293e437c, user_id=c8ddca77078e4d0fbde5687ef5dcac19, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.171347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.258717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1071/2157] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:48 2022] PUT /identity/v3/projects/fabc90c5580d4017a5da8c5f293e437c/users/c8ddca77078e4d0fbde5687ef5dcac19/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:48.261951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.277209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5aa7e-4858-40a3-824e-27642f2261d0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.351713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.352423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.352719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.352982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.353731 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.355368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585deaf-da1b-4864-86d4-d09578c4411e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.371033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1087/2158] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:48.372681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.383462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076e77d-ff07-4ab1-93b2-66e108c76f17 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.389085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.390055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.390393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.390721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] PATH_INFO: `/v3/projects/fabc90c5580d4017a5da8c5f293e437c/users/c8ddca77078e4d0fbde5687ef5dcac19/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.392994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc90c5580d4017a5da8c5f293e437c, user_id=c8ddca77078e4d0fbde5687ef5dcac19, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.395680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.408134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1072/2159] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:48 2022] PUT /identity/v3/projects/fabc90c5580d4017a5da8c5f293e437c/users/c8ddca77078e4d0fbde5687ef5dcac19/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:48.418552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.419001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.419379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.449818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] MFA Rules not processed for user `c8ddca77078e4d0fbde5687ef5dcac19`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:48.451043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:48.517426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1088/2160] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:48.527958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.529816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:48.585506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635215-5f01-41f4-9910-4e8aeb6d5eca admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.589499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.590181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.590454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.590722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.604079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.606231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.618542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1073/2161] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:48.680703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:48.693471 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31bba-5e2e-4b62-a9a3-71107c3bfa83 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:48.699166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:48.700006 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:48.700687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:48.701118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:48.777946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:48.778727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3c05f-a52b-4b97-a3e4-299ceb316198 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:48.789034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1089/2162] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:49.824501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:49.828195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:49.902485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e8c53-6960-4859-a945-8e88aed82d59 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:49.907164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:49.908031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:49.908309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:49.908579 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] PATH_INFO: `/v3/users/3efd0660386f44dbbc6f5f45f3ab63c9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:49.909859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efd0660386f44dbbc6f5f45f3ab63c9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:49.911872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:50.094024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efd0660386f44dbbc6f5f45f3ab63c9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:50.100627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efd0660386f44dbbc6f5f45f3ab63c9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:50.197844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efd0660386f44dbbc6f5f45f3ab63c9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:50.219660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efd0660386f44dbbc6f5f45f3ab63c9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:50.220576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efd0660386f44dbbc6f5f45f3ab63c9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:50.227334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1074/2163] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:49 2022] DELETE /identity/v3/users/3efd0660386f44dbbc6f5f45f3ab63c9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:50.236115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:50.236712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:50.236712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:50.255959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:50.257151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:50.318947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1090/2164] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:32:50.327659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:50.329020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:50.384666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ac807-46ed-40ed-86fa-8abc4331990a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:50.388907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:50.398987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:50.398987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:50.398987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:50.398987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:50.400300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b462-f0f8-40ed-a5ed-6fd783f4fc54 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:50.410190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1075/2165] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:50.870257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:50.871986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:50.894645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b030831-1a71-4d59-a92c-c191d7a90dd6 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:50.902258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:50.903403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:50.903845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:50.904209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] PATH_INFO: `/v3/projects/58df856224c84d298865e9687aaaef2f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:50.905805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58df856224c84d298865e9687aaaef2f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:50.908416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.039990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58df856224c84d298865e9687aaaef2f', 'request_id': 'req-531c2d1b-9590-4fc3-a3cd-b387059b93a0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:51.045827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58df856224c84d298865e9687aaaef2f', 'request_id': 'req-531c2d1b-9590-4fc3-a3cd-b387059b93a0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:51.051969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58df856224c84d298865e9687aaaef2f', 'request_id': 'req-531c2d1b-9590-4fc3-a3cd-b387059b93a0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:51.159279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] The token cache is being invalidate because project 58df856224c84d298865e9687aaaef2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:51.159566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:51.160178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-531c2d1b-9590-4fc3-a3cd-b387059b93a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:51.161726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1091/2166] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:50 2022] DELETE /identity/v3/projects/58df856224c84d298865e9687aaaef2f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:51.166495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.167465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.167558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.185403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:51.186693 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:51.254303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1076/2167] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:51.263256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.263744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.264039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.283703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:51.285262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:51.294713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1092/2168] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:51.298874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.309124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7850-319a-4a39-8df4-696abd8cda6d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.314081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.314916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.315196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.315464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.316192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:32:51.316651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.318351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.332115 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1077/2169] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:32:51.336615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.346433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aebe56-6a3a-42ad-ae57-f94d1ca5cb2c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.351599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.352157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.352420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.352713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.353374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.362367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.478128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1093/2170] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:32:51 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:32:51.478986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.492747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075c64-ac81-4771-a73f-44fcec439617 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.564828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.565617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.566013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.566524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.567323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.569302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.673593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1078/2171] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:32:51 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:32:51.674375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.685263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd884-4862-43a5-a66f-95d6444be7e5 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.689936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.690595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.690874 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.691145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.691859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.693463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.704575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1094/2172] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:51.708763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.719655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db784df-9471-456f-a87e-908e825d8ac2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.724311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.724963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.725246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.725517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.726264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.727850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000e62-190d-45e3-a20e-eae92df29b1f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.738907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1079/2173] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:32:51.748812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:51.759061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ee53-99c9-4153-be1b-0ca50ab2bb6b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:51.765071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:51.766368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.766841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.767294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] PATH_INFO: `/v3/projects/5457058742c54cafb92bc7625bce457b/users/99711310e52f478da383a21a65218043/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.796457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5457058742c54cafb92bc7625bce457b, user_id=99711310e52f478da383a21a65218043, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:51.799544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:51.920494 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1095/2174] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:32:51 2022] PUT /identity/v3/projects/5457058742c54cafb92bc7625bce457b/users/99711310e52f478da383a21a65218043/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:51.931366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:51.931865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:51.932224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:51.965996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] MFA Rules not processed for user `99711310e52f478da383a21a65218043`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:51.967233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:52.059399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1080/2175] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:52.071950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:52.074618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:52.164261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdb39d-15d0-4999-ac89-f20a1bfb2854 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:52.168248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:52.169155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:52.169433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:52.169735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:52.178499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:52.179963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be794a46-020f-4e79-97a9-a3435656b6cd service glance] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:52.192619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1096/2176] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:57.476017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:57.477860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:57.556504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651d8e2-d4c5-4038-b84e-db57c9dbbbbc None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:57.564071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:57.564071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:57.564071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:57.564442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] PATH_INFO: `/v3/users/f9e1dbe1b9cf4913a67208ae290329c8` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:57.566172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e1dbe1b9cf4913a67208ae290329c8)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:57.568761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:57.798484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e1dbe1b9cf4913a67208ae290329c8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:57.819696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e1dbe1b9cf4913a67208ae290329c8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:57.885991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e1dbe1b9cf4913a67208ae290329c8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:57.898483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e1dbe1b9cf4913a67208ae290329c8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:57.899131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e1dbe1b9cf4913a67208ae290329c8'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:57.905579 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1081/2177] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:57 2022] DELETE /identity/v3/users/f9e1dbe1b9cf4913a67208ae290329c8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:57.910191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984042b4-9f62-4647-9257-41c431af948f None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:57.910699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984042b4-9f62-4647-9257-41c431af948f None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:57.910792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984042b4-9f62-4647-9257-41c431af948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:57.929245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-984042b4-9f62-4647-9257-41c431af948f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:32:57.930611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-984042b4-9f62-4647-9257-41c431af948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:58.003109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1097/2178] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:32:58.013367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:58.014943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:58.073686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdb05-dd2c-4d67-a6e3-4a479fb9a181 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:58.077959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:58.078591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:58.078872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:58.079161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:58.091710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:58.093182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:58.103719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1082/2179] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:32:58.545482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984042b4-9f62-4647-9257-41c431af948f None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:58.546960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-984042b4-9f62-4647-9257-41c431af948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:58.563312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984042b4-9f62-4647-9257-41c431af948f None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:58.569184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:58.570162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:58.570441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:58.570720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] PATH_INFO: `/v3/projects/eaca084d21214dcd8be6170bceae5359` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:58.572250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaca084d21214dcd8be6170bceae5359)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:58.574547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:58.880383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaca084d21214dcd8be6170bceae5359', 'request_id': 'req-c452dd78-f317-4595-bc14-02c7e1a1ceb0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:58.880383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaca084d21214dcd8be6170bceae5359', 'request_id': 'req-c452dd78-f317-4595-bc14-02c7e1a1ceb0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:58.880383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaca084d21214dcd8be6170bceae5359', 'request_id': 'req-c452dd78-f317-4595-bc14-02c7e1a1ceb0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.000386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] The token cache is being invalidate because project eaca084d21214dcd8be6170bceae5359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:32:59.001777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.002912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.005250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1098/2180] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:58 2022] DELETE /identity/v3/projects/eaca084d21214dcd8be6170bceae5359 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:59.013257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:59.027011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f9fa4-c1a3-4db1-88f0-effdab042f0e service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:59.112536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:59.113465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:59.113784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:59.114633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] PATH_INFO: `/v3/users/c8ddca77078e4d0fbde5687ef5dcac19` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:59.116327 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ddca77078e4d0fbde5687ef5dcac19)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:59.118481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:32:59.333723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ddca77078e4d0fbde5687ef5dcac19'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.341767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ddca77078e4d0fbde5687ef5dcac19'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.434331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ddca77078e4d0fbde5687ef5dcac19'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.446755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ddca77078e4d0fbde5687ef5dcac19'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.447468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ddca77078e4d0fbde5687ef5dcac19'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:32:59.454011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1083/2181] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:32:59 2022] DELETE /identity/v3/users/c8ddca77078e4d0fbde5687ef5dcac19 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:32:59.873913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:32:59.875537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:32:59.889486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452dd78-f317-4595-bc14-02c7e1a1ceb0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:32:59.958149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:32:59.959024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:32:59.959306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:32:59.959577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] PATH_INFO: `/v3/projects/fabc90c5580d4017a5da8c5f293e437c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:32:59.960770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabc90c5580d4017a5da8c5f293e437c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:32:59.963055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:00.061217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabc90c5580d4017a5da8c5f293e437c', 'request_id': 'req-8d951012-f0d5-47bd-a00d-eaedc91f40ec'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:00.066303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabc90c5580d4017a5da8c5f293e437c', 'request_id': 'req-8d951012-f0d5-47bd-a00d-eaedc91f40ec'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:00.072451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabc90c5580d4017a5da8c5f293e437c', 'request_id': 'req-8d951012-f0d5-47bd-a00d-eaedc91f40ec'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:00.177024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] The token cache is being invalidate because project fabc90c5580d4017a5da8c5f293e437c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:33:00.177313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:00.177961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d951012-f0d5-47bd-a00d-eaedc91f40ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:00.180955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1099/2182] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:32:59 2022] DELETE /identity/v3/projects/fabc90c5580d4017a5da8c5f293e437c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:02.213743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:02.215203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:02.230866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d15ce-34d7-47d9-aa29-e0355b9ca5c8 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:02.299616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:02.300670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:02.300949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:02.301277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] PATH_INFO: `/v3/users/d7cb2c883361432fae114d8271792433` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:02.306431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cb2c883361432fae114d8271792433)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:02.308964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:02.539922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cb2c883361432fae114d8271792433'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:02.547262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cb2c883361432fae114d8271792433'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:02.640849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cb2c883361432fae114d8271792433'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:02.655593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cb2c883361432fae114d8271792433'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:02.656315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cb2c883361432fae114d8271792433'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:02.662350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1084/2183] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:33:02 2022] DELETE /identity/v3/users/d7cb2c883361432fae114d8271792433 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:02.667025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f3a3-9cfc-4864-87dd-1e812d85c545 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:02.671552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f3a3-9cfc-4864-87dd-1e812d85c545 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:02.671552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f3a3-9cfc-4864-87dd-1e812d85c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:02.686142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ee67f3a3-9cfc-4864-87dd-1e812d85c545 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:02.687359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ee67f3a3-9cfc-4864-87dd-1e812d85c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:02.753368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1100/2184] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:33:02.764212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:02.765792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:02.826768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32fd2-89ab-4cf3-954e-0440cbfe1b5a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:02.830376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:02.831381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:02.831666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:02.831938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:02.842491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:02.843940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:02.853362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1085/2185] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:03.139168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f5bb-efcc-4d48-92f8-deec4bd68ffa None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.139459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f5bb-efcc-4d48-92f8-deec4bd68ffa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.139739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f5bb-efcc-4d48-92f8-deec4bd68ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.157998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c869f5bb-efcc-4d48-92f8-deec4bd68ffa None None] MFA Rules not processed for user `d7dc29e12afd4eccb3a311ebaa3061ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:03.159221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c869f5bb-efcc-4d48-92f8-deec4bd68ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:03.218352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1101/2186] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:03.267023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:03.268772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:03.303951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3a80-44b4-452f-8c99-7245f5a45639 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:03.308895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:03.309779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.310072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.310332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] PATH_INFO: `/v3/projects/6a96671583c94c99a618651c99a5c458` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.311509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a96671583c94c99a618651c99a5c458)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:03.313418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:03.418057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a96671583c94c99a618651c99a5c458', 'request_id': 'req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:03.423548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a96671583c94c99a618651c99a5c458', 'request_id': 'req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:03.497117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a96671583c94c99a618651c99a5c458', 'request_id': 'req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:03.509227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] The token cache is being invalidate because project 6a96671583c94c99a618651c99a5c458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:33:03.509517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:03.510829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7b5bbc83-ff4c-4657-bcb5-b3ac07adb949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:03.513769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1086/2187] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:33:03 2022] DELETE /identity/v3/projects/6a96671583c94c99a618651c99a5c458 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:03.520223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.520509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.520778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.539140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:03.540758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:03.603632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1102/2188] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:03.612045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.612372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.612652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.631157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:03.632354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:03.643271 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1087/2189] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:33:03.645497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:03.655070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e644a08-d28b-4802-a2c2-4696e0f23180 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:03.659750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:03.663021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.663021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.663021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.663021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:33:03.663021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:03.663645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:03.675146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1103/2190] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:33:03.679504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:03.689319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb3d9a-6f52-4025-9cc6-2b8b4555065a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:03.694387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:03.695275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.695568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.695846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.696544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:03.699197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:03.786897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1088/2191] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:33:03 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:33:03.790955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:03.802403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219c7d-10e5-4926-8065-3a47d407a6f8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:03.860289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:03.860951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.861298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.861625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.862373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:03.864362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:03.966180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1104/2192] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:33:03 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:33:03.971133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:03.981610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347057a-3a9a-420b-a4a6-aa3c5765c879 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:03.986169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:03.986912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:03.987138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:03.987410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:03.988122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:03.989851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:04.000517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1089/2193] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:33:04.005948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:04.017233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e54bf3-cdb9-48b5-b44f-28fb506e50cc admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:04.024157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:04.026421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:04.026421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:04.026421 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:04.026732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:04.028349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5499-2b14-43bf-a886-82d617edcc99 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:04.038724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1105/2194] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:33:04.042983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:04.052779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c91a-b947-4855-98bb-dfd745fbb46e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:04.062170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:04.063086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:04.063373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:04.063648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] PATH_INFO: `/v3/projects/8fcb2a54095042de8f8a080ac25139a8/users/1fa24f91bca34d949b0f25bb4388e3a4/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:04.079113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcb2a54095042de8f8a080ac25139a8, user_id=1fa24f91bca34d949b0f25bb4388e3a4, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:04.081854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:04.177695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1090/2195] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:33:04 2022] PUT /identity/v3/projects/8fcb2a54095042de8f8a080ac25139a8/users/1fa24f91bca34d949b0f25bb4388e3a4/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:04.184530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab1ea-4311-41d4-9845-2b926a1479f2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:04.184911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab1ea-4311-41d4-9845-2b926a1479f2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:04.185192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab1ea-4311-41d4-9845-2b926a1479f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:04.204573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d8fab1ea-4311-41d4-9845-2b926a1479f2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:04.205784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d8fab1ea-4311-41d4-9845-2b926a1479f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:04.267088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1106/2196] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:33:04.277054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:04.278791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:04.337104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56b9b4-ed9e-430e-b465-d080820bd62c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:04.341259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:04.341923 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:04.342203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:04.342476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:04.351191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:04.352613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326bea-15ef-46d8-ab81-5de540b9f5d3 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:04.361839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1091/2197] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:05.984393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:05.984883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:05.984992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:06.003372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] MFA Rules not processed for user `556f14d079254d7e91fc1e942e2a30a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:06.004820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:06.074127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1107/2198] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:09.917647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:09.918178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:09.918599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:09.950834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] MFA Rules not processed for user `1fa24f91bca34d949b0f25bb4388e3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:09.952037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:10.029006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1092/2199] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:10.034003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.044782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b241e60-016a-492e-babd-68a3db31b917 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.049204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.049882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.050166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.050442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.051167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.053088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.124625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1108/2200] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:33:10 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:33:10.125754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.136777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36ebd5-d4d0-4ff7-8b8c-ad55d938b062 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.191855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.192537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.192818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.193089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.193826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.195905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.268723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1093/2201] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:33:10 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:33:10.272472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.282678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a632-b2ff-4a20-a94b-0c0b9adfab73 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.287273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.287922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.288207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.288485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.289202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.290897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.303741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1109/2202] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:33:10.308417 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.318571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089447f-b8f7-4edc-9cca-43bcc61d03df admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.324320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.325196 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.325480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.325821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] PATH_INFO: `/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8/users/dc865dc47a3648be879c835efd2fa9e4/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.344659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1cef3eb75e42ee8239eeee32937fd8, user_id=dc865dc47a3648be879c835efd2fa9e4, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.347575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.417929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1094/2203] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:33:10 2022] PUT /identity/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8/users/dc865dc47a3648be879c835efd2fa9e4/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:10.422050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.436087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469c8f2-f67b-4d8d-85c1-d71cf7996ba4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.497836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.498678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.499204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.499631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.500466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.502540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397563d1-3c0e-4475-8698-5ef95e814519 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.514674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1110/2204] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:33:10.518942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:10.535334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2251d4-87ee-4e15-a3c8-a42ad2f446f6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:10.540268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:10.541177 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:10.541455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:10.541771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] PATH_INFO: `/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8/users/dc865dc47a3648be879c835efd2fa9e4/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:10.553579 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1cef3eb75e42ee8239eeee32937fd8, user_id=dc865dc47a3648be879c835efd2fa9e4, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:10.556550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:10.568225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1095/2205] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:33:10 2022] PUT /identity/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8/users/dc865dc47a3648be879c835efd2fa9e4/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:33:19.011170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793712f-fc9e-464e-84ee-18c190091bf8 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:19.011693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793712f-fc9e-464e-84ee-18c190091bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:19.011776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793712f-fc9e-464e-84ee-18c190091bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:19.051182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5793712f-fc9e-464e-84ee-18c190091bf8 None None] MFA Rules not processed for user `dc865dc47a3648be879c835efd2fa9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:19.052479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5793712f-fc9e-464e-84ee-18c190091bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:19.242929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1111/2206] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:19.254942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:19.256551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:19.397391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af7d2b-f83a-4f6a-b209-19a5825853d1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:19.402736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:19.403527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:19.404232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:19.404232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:19.499156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:19.500917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:19.514475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1096/2207] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:19.885822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef509e-e263-4c6f-9b2f-b01b672924a7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:19.886148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef509e-e263-4c6f-9b2f-b01b672924a7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:19.886402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef509e-e263-4c6f-9b2f-b01b672924a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:19.914312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-00ef509e-e263-4c6f-9b2f-b01b672924a7 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:19.915488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-00ef509e-e263-4c6f-9b2f-b01b672924a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:19.989437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1112/2208] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:33:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:19.997167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:19.999624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:20.102225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66319-6443-4a69-a93d-b447a4cc58ad service glance] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:20.108738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:20.109525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:20.109906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:20.110229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:20.119865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:20.121635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:20.140300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1097/2209] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:33:22.022721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:22.023295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:22.023295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:22.049043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:22.050692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:22.067912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1113/2210] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:22.086079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:22.101969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e5fc-3d9b-4e15-9a9d-ba7a2e88ee51 service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:22.115068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:22.115749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:22.116031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:22.116309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:22.136589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:22.138311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f619b-289c-4949-8b66-65a3d91de997 service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:22.153893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1098/2211] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:33:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:33:31.795822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:31.797423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:31.983232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd1d46-bc2b-4d97-ac29-42747f7bafae None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:31.995293 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:31.997132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:31.998215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:31.998746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] PATH_INFO: `/v3/users/99711310e52f478da383a21a65218043` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:32.002240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99711310e52f478da383a21a65218043)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:32.005187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:32.279788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99711310e52f478da383a21a65218043'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:32.301749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99711310e52f478da383a21a65218043'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:32.335816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99711310e52f478da383a21a65218043'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:32.335816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99711310e52f478da383a21a65218043'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:32.457146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99711310e52f478da383a21a65218043'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:32.468199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1114/2212] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:33:31 2022] DELETE /identity/v3/users/99711310e52f478da383a21a65218043 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:32.476185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:32.477100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:32.477575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:32.531723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:32.533208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:32.662287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1099/2213] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:32.672422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:32.673983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:32.895184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732444a9-717d-4988-812f-06a05a5a1b45 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:32.902537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:32.903737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:32.904237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:32.904916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:32.933702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:32.936897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df33cd-6321-4a42-b082-ca20c0da62f3 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:32.950758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1115/2214] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:34.231236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:34.232901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:34.268722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8ebeb-ed6d-4bf5-abe3-5cc4794bd73d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:34.282659 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:34.291328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:34.291999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:34.292490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] PATH_INFO: `/v3/projects/5457058742c54cafb92bc7625bce457b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:34.295002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5457058742c54cafb92bc7625bce457b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:34.298191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:34.579278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5457058742c54cafb92bc7625bce457b', 'request_id': 'req-308ef193-bdd5-45d5-b141-32f607167a86'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:34.598475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5457058742c54cafb92bc7625bce457b', 'request_id': 'req-308ef193-bdd5-45d5-b141-32f607167a86'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:34.703155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5457058742c54cafb92bc7625bce457b', 'request_id': 'req-308ef193-bdd5-45d5-b141-32f607167a86'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:34.723038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] The token cache is being invalidate because project 5457058742c54cafb92bc7625bce457b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:33:34.723389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:34.724183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-308ef193-bdd5-45d5-b141-32f607167a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:34.729120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1100/2215] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:33:34 2022] DELETE /identity/v3/projects/5457058742c54cafb92bc7625bce457b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:34.734259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:34.734779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:34.734870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:34.832034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:34.833346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:34.907676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1116/2216] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:34.916278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:34.916859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:34.917409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:34.957758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:34.957758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:34.966083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1101/2217] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:34.975491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:34.990859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49af0d-0737-4ef7-acc2-97e4b08a7c40 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.001007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.001007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.001007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.001920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.004154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:33:35.004569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.007254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.022055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1117/2218] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:33:35.026167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.037941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f199e-9da7-4b4f-b027-81e2e7e0c502 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.043567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.044499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.045649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.046905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.047914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.050419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.144651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1102/2219] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:33:35 2022] POST /identity/v3/projects => generated 395 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:33:35.148918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.161744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed77d-6dff-48c8-af09-39b453f5e7e1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.245873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.247388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.248495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.249009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.250391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.253976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.360862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1118/2220] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:33:35 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:33:35.368351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.380703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8baec-d758-453e-a52d-2b5865a944c0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.390283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.390958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.391433 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.391674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.392539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.397393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dfd89-f287-468f-a952-f336171e57d4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.426555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1103/2221] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:33:35.429170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.443173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79812295-4e46-4523-93d8-baa85da63555 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.451051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.452909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.453440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.453940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.454877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.460988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.477366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61668f-96ec-4fe1-98df-8b92b355688b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.477915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61668f-96ec-4fe1-98df-8b92b355688b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.478206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61668f-96ec-4fe1-98df-8b92b355688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.491861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1119/2222] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:33:35.499373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.500632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ac61668f-96ec-4fe1-98df-8b92b355688b None None] MFA Rules not processed for user `1fa24f91bca34d949b0f25bb4388e3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:35.502784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ac61668f-96ec-4fe1-98df-8b92b355688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:35.528597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44296be-fe1c-4f2a-9ea5-7378f9690fed admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:35.540920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:35.542139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.542397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.542771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] PATH_INFO: `/v3/projects/cb5618f718f34ec0aa51f20bafbfd715/users/b46ac8fbcbb24f989acf172bb3ede9f1/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.578610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5618f718f34ec0aa51f20bafbfd715, user_id=b46ac8fbcbb24f989acf172bb3ede9f1, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:35.583053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:35.642617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1104/2223] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:33:35.691044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1120/2224] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:33:35 2022] PUT /identity/v3/projects/cb5618f718f34ec0aa51f20bafbfd715/users/b46ac8fbcbb24f989acf172bb3ede9f1/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:35.702810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82efd2-1a85-4c7e-86b0-5192da7688e0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:35.703580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82efd2-1a85-4c7e-86b0-5192da7688e0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:35.704055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82efd2-1a85-4c7e-86b0-5192da7688e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:35.747947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9a82efd2-1a85-4c7e-86b0-5192da7688e0 None None] MFA Rules not processed for user `b46ac8fbcbb24f989acf172bb3ede9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:35.749518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9a82efd2-1a85-4c7e-86b0-5192da7688e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:35.911870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1105/2225] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:35.921021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:35.923627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:36.013691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85482-29bd-4555-811e-8afcb7624591 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:36.023707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:36.024509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:36.024954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:36.025331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:36.038316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:36.039819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:36.053805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1121/2226] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:43.170078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:43.170611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:43.171082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:43.201808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:43.203007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:43.260039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1106/2227] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:33:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:33:43.270052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:43.271607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:43.372159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c645ce8-a586-49a4-a9c8-d218f60c4b12 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:43.381150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:43.382051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:43.382508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:43.382871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:43.403200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:43.405218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d50b1-787d-46c5-8c4b-6d39b6c07eea service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:43.415878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1122/2228] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:33:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:33:49.231676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:49.303200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc819-c614-4578-b4a7-265bc8b425c4 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:49.307803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:49.308660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:49.308942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:49.309213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] PATH_INFO: `/v3/users/b46ac8fbcbb24f989acf172bb3ede9f1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:49.310416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46ac8fbcbb24f989acf172bb3ede9f1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:49.312436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:49.520199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46ac8fbcbb24f989acf172bb3ede9f1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:49.522510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46ac8fbcbb24f989acf172bb3ede9f1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:49.599431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46ac8fbcbb24f989acf172bb3ede9f1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:49.612149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46ac8fbcbb24f989acf172bb3ede9f1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:49.612779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46ac8fbcbb24f989acf172bb3ede9f1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:49.618551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1107/2229] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:33:49 2022] DELETE /identity/v3/users/b46ac8fbcbb24f989acf172bb3ede9f1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:33:49.623142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:49.623651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:49.623651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:49.642771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:33:49.643972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:49.718310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1123/2230] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:33:49.728157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:49.729605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:49.790543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adcfb4-4b90-4424-ae9f-82c8c78e32fa admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:49.794845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:49.795608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:49.795889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:49.796165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:49.806266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:49.807719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:49.817036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1108/2231] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:33:50.300778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:50.300778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:50.316968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ae9aa-ba94-4385-8d7a-05793e98d7d5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:50.324603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:50.325537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:50.325857 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:50.326136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] PATH_INFO: `/v3/projects/cb5618f718f34ec0aa51f20bafbfd715` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:50.327368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5618f718f34ec0aa51f20bafbfd715)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:50.329736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:50.484815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5618f718f34ec0aa51f20bafbfd715', 'request_id': 'req-853bf9ad-6e80-4fc2-b717-157969522971'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:50.490011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5618f718f34ec0aa51f20bafbfd715', 'request_id': 'req-853bf9ad-6e80-4fc2-b717-157969522971'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:50.496124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5618f718f34ec0aa51f20bafbfd715', 'request_id': 'req-853bf9ad-6e80-4fc2-b717-157969522971'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:50.633185 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] The token cache is being invalidate because project cb5618f718f34ec0aa51f20bafbfd715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:33:50.633916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:50.634167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-853bf9ad-6e80-4fc2-b717-157969522971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:33:50.636358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1124/2232] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:33:50 2022] DELETE /identity/v3/projects/cb5618f718f34ec0aa51f20bafbfd715 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:33:58.402901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:33:58.404370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:58.499538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded0e9-624a-4d5f-9cab-088cef7856eb service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:33:58.571010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:33:58.572267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:33:58.572545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:33:58.572814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:33:58.574642 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:33:58.586735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:33:58.589166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab97a-81d9-416a-9de5-7a423e075a95 service placement] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:33:58.599326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1109/2233] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:33:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:34:01.523314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:01.524359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:01.524858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:01.527503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1125/2234] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:34:01.534366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93ff6-fcc5-48b5-88c1-637607672fdb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:01.535224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93ff6-fcc5-48b5-88c1-637607672fdb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:01.541731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93ff6-fcc5-48b5-88c1-637607672fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:01.599207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-79d93ff6-fcc5-48b5-88c1-637607672fdb None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:01.600467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-79d93ff6-fcc5-48b5-88c1-637607672fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:01.689951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1110/2235] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:34:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:34:01.702619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:01.704407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:01.763354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb765-0941-427a-8985-0e7b16baf14b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:01.767103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:01.767756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:01.768028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:01.768297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:01.779664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:01.781290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6978f-81e8-44e1-b478-1b083f4e35a4 service glance] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:01.792171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1126/2236] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:34:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:34:02.041602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.042562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.043967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] PATH_INFO: `/` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.044662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1111/2237] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:34:02.049639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0dfd-62c1-4eac-b501-48e6e9e9ca46 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.050016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0dfd-62c1-4eac-b501-48e6e9e9ca46 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.050285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0dfd-62c1-4eac-b501-48e6e9e9ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.067915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-698c0dfd-62c1-4eac-b501-48e6e9e9ca46 None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:02.069107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-698c0dfd-62c1-4eac-b501-48e6e9e9ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:02.120408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1127/2238] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:34:02.132032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:02.133875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:02.146761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8c87-eaed-46f5-97cc-8bb757ce5eba None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:02.150169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:02.150828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.151606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.152310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.159209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:02.160622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062492c8-777b-4926-82e9-dde37996165b service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:02.169449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1112/2239] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:34:02.256641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675bfd-b573-4a4d-9396-73ab6b47e22c None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.256930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675bfd-b573-4a4d-9396-73ab6b47e22c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.257209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675bfd-b573-4a4d-9396-73ab6b47e22c None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.259043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1128/2240] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 25 03:34:02.264955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a694d5-67e1-4261-9f0e-1ef6944aa5e6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.265176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a694d5-67e1-4261-9f0e-1ef6944aa5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.265442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a694d5-67e1-4261-9f0e-1ef6944aa5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.283688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d4a694d5-67e1-4261-9f0e-1ef6944aa5e6 None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:02.284860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d4a694d5-67e1-4261-9f0e-1ef6944aa5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:02.293871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1113/2241] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:34:02.303977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c675bfd-b573-4a4d-9396-73ab6b47e22c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:02.314868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c675bfd-b573-4a4d-9396-73ab6b47e22c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:02.318428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:02.319060 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:02.319345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:02.319622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:02.330279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:02.331757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:02.343592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1129/2242] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:34:10.162029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:10.162602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:10.162602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:10.180313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:10.181540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:10.236282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1114/2243] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:34:10.248813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:10.250209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:10.319114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3249462-f6b3-4c21-8d0d-051458c5d583 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:10.324143 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:10.325305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:10.325588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:10.325890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:10.333750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:10.335351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9449d07-4f6f-4273-895f-169073cda58e service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:10.343520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1130/2244] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:34:27.291611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:27.300779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad17e-9106-4fe2-bc67-075944d63226 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:27.304397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:27.306938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:27.306938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:27.306938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:27.307354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:27.367289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:27.368714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fa34a-5ca7-46b3-8571-45b18dfdca52 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:27.377824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1115/2245] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:34:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:34:32.097096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166066c7-881a-4644-924e-55230c889b70 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:32.098351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166066c7-881a-4644-924e-55230c889b70 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:32.098798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166066c7-881a-4644-924e-55230c889b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:32.117472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-166066c7-881a-4644-924e-55230c889b70 None None] MFA Rules not processed for user `1f0bf46ff1854167a61427a582b39ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:32.118737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-166066c7-881a-4644-924e-55230c889b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:32.189516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1131/2246] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:34:36.150032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005db25-d9f7-4622-9554-ff2c1678cdb6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:36.150615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005db25-d9f7-4622-9554-ff2c1678cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:36.150615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005db25-d9f7-4622-9554-ff2c1678cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:36.271720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0005db25-d9f7-4622-9554-ff2c1678cdb6 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:36.273006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0005db25-d9f7-4622-9554-ff2c1678cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:36.296518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1116/2247] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:34:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:34:36.322304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166066c7-881a-4644-924e-55230c889b70 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:34:36.345811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166066c7-881a-4644-924e-55230c889b70 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:34:36.351318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:34:36.352162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:36.352444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:36.352714 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:36.361314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:34:36.363200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2d8d8-34d3-4003-b4f3-136aaf35da71 service swift] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:34:36.378631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1132/2248] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:34:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:34:49.807103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60d80-c224-43b8-ac7e-f7410e2d041a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:34:49.807855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60d80-c224-43b8-ac7e-f7410e2d041a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:34:49.807855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60d80-c224-43b8-ac7e-f7410e2d041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:34:49.825739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-09d60d80-c224-43b8-ac7e-f7410e2d041a None None] MFA Rules not processed for user `556f14d079254d7e91fc1e942e2a30a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:34:49.827063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-09d60d80-c224-43b8-ac7e-f7410e2d041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:34:49.882669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1117/2249] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:04.983033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:04.983608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:04.983734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:05.002505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] MFA Rules not processed for user `d7dc29e12afd4eccb3a311ebaa3061ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:05.003710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:05.060014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1133/2250] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:39.915069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:39.915667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:39.915667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:39.932931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] MFA Rules not processed for user `0092d4e191b14af3b1f799271c19fa73`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:39.934701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:39.992180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1118/2251] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:42.845590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:42.847802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:42.921688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed6b26-7131-4735-be92-c4c6c910b412 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:42.926447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:42.927318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:42.927604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:42.927881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] PATH_INFO: `/v3/users/1f0bf46ff1854167a61427a582b39ac6` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:42.929083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0bf46ff1854167a61427a582b39ac6)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:42.931615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:43.224493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0bf46ff1854167a61427a582b39ac6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.231179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0bf46ff1854167a61427a582b39ac6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.242398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0bf46ff1854167a61427a582b39ac6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.243147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0bf46ff1854167a61427a582b39ac6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.347340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7b990757-7a08-4513-b662-386b00417622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0bf46ff1854167a61427a582b39ac6'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.356940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1134/2252] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:35:42 2022] DELETE /identity/v3/users/1f0bf46ff1854167a61427a582b39ac6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:35:43.623480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:43.637745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7a3c8-704b-46d1-8550-8aab89dedbbf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:43.704031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:43.705363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:43.705735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:43.705963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] PATH_INFO: `/v3/projects/a5185ed76d0a4079bda29a0cf1b3f428` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:43.707139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5185ed76d0a4079bda29a0cf1b3f428)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:43.709071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:43.849968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5185ed76d0a4079bda29a0cf1b3f428', 'request_id': 'req-ef4a3592-16cc-4978-84ae-24bfa8a33279'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.856697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5185ed76d0a4079bda29a0cf1b3f428', 'request_id': 'req-ef4a3592-16cc-4978-84ae-24bfa8a33279'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.936311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5185ed76d0a4079bda29a0cf1b3f428', 'request_id': 'req-ef4a3592-16cc-4978-84ae-24bfa8a33279'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.952639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] The token cache is being invalidate because project a5185ed76d0a4079bda29a0cf1b3f428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:35:43.952934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.953608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ef4a3592-16cc-4978-84ae-24bfa8a33279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:35:43.959312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1119/2253] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:35:43 2022] DELETE /identity/v3/projects/a5185ed76d0a4079bda29a0cf1b3f428 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:35:43.962764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766027-671c-4646-9180-42f2de771d67 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:43.962764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766027-671c-4646-9180-42f2de771d67 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:43.962764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766027-671c-4646-9180-42f2de771d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:43.998167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-79766027-671c-4646-9180-42f2de771d67 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:44.000774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-79766027-671c-4646-9180-42f2de771d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:44.095120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.095408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.095689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.097267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1135/2254] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:44.116199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:44.117497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:44.125779 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1120/2255] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:44.130035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766027-671c-4646-9180-42f2de771d67 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.140622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766027-671c-4646-9180-42f2de771d67 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.145635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.146320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.146602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.146872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.147594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:35:44.147894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.149690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.162941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1136/2256] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:35:44.167383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.178600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f014240-e8b4-4730-8517-2cb167b58a0a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.184720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.185535 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.185874 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.186146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.186968 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.189162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.279912 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1121/2257] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:35:44 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:35:44.284173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.295362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ece3-bc49-4eaa-b4e5-634dbb019e44 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.353705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.354369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.354655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.354927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.355767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.357554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.457066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1137/2258] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:35:44 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:35:44.462446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.471819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498232c-b902-4c19-9b3f-8bcd5c96dc8e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.476498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.477157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.477469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.477776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.478499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.480113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.491074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1122/2259] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:35:44.495246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.506917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd9f0a-8ed1-4da3-8d93-d6010a312855 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.511573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.512378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.512683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.512958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.514071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.515746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d3f7-f304-4a4e-9d0e-7a5123663ffd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.526081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1138/2260] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:35:44.530343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.540265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61c30-440f-440c-befd-e9b8aaa28f19 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.545563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.546552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.546903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.547245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] PATH_INFO: `/v3/projects/48056ec4a0a14de9bc3675f24e816164/users/dbfc5ac653fa4809a732bdef3b43a8be/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.563210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48056ec4a0a14de9bc3675f24e816164, user_id=dbfc5ac653fa4809a732bdef3b43a8be, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.570281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.691193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1123/2261] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:35:44 2022] PUT /identity/v3/projects/48056ec4a0a14de9bc3675f24e816164/users/dbfc5ac653fa4809a732bdef3b43a8be/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:35:44.696501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718cbb8-2162-4ff1-830d-e74cd9669edf None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.696750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718cbb8-2162-4ff1-830d-e74cd9669edf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.697185 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718cbb8-2162-4ff1-830d-e74cd9669edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.721195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5718cbb8-2162-4ff1-830d-e74cd9669edf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:44.727317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5718cbb8-2162-4ff1-830d-e74cd9669edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:44.789423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1139/2262] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:44.799863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:44.801996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:44.872239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4a20-087f-42f1-bce0-6577f0cfebeb admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:44.876528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:44.877178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:44.877470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:44.877795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:44.887287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:44.888731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:44.898514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1124/2263] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:35:50.582463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:50.583001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:50.583810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:50.615021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] MFA Rules not processed for user `dbfc5ac653fa4809a732bdef3b43a8be`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:50.616241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:50.698313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1140/2264] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:50.738895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:50.749442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe93893-d465-499c-8d47-e8c754f247fa service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:50.754155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:50.754822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:50.755086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:50.755358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:50.756045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:50.758005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:50.892074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1125/2265] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:35:50 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:35:50.896194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:50.907928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4368e0-42f7-48c0-83af-92f33f84892d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:50.966254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:50.966928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:50.967205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:50.967475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:50.968170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:50.970147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:51.072218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1141/2266] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:35:50 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:35:51.077919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:51.089315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919509-17da-4f81-b7fe-83c59cd15e06 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:51.094672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:51.095336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:51.095620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:51.095897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:51.096613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:51.098253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:51.109321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1126/2267] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:35:51.113886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:51.125912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756caed-cbd5-4def-8850-c42140f7c96e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:51.130665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:51.131553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:51.131839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:51.132115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] PATH_INFO: `/v3/projects/c35f84afe6364992963940ca78607d2e/users/fc016a84e19c4e8eba776239372fc198/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:51.150539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35f84afe6364992963940ca78607d2e, user_id=fc016a84e19c4e8eba776239372fc198, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:51.153920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:51.260694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1142/2268] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:35:51 2022] PUT /identity/v3/projects/c35f84afe6364992963940ca78607d2e/users/fc016a84e19c4e8eba776239372fc198/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:35:51.265164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:51.275364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2af918-a212-407b-a11e-c090d865437b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:51.336134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:51.336720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:51.337005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:51.337307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:51.338072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:51.339722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:51.351262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1127/2269] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:35:51.355526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:51.366321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aceec-97d7-47ee-bc52-8867f7ecac7f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:51.371184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:51.372079 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:51.372360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:51.372631 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] PATH_INFO: `/v3/projects/c35f84afe6364992963940ca78607d2e/users/fc016a84e19c4e8eba776239372fc198/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:51.374756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35f84afe6364992963940ca78607d2e, user_id=fc016a84e19c4e8eba776239372fc198, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:51.377559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:51.389393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1143/2270] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:35:51 2022] PUT /identity/v3/projects/c35f84afe6364992963940ca78607d2e/users/fc016a84e19c4e8eba776239372fc198/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:35:56.998703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:57.071741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5c4f8-2843-4ff6-802f-e5f079ef816d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:57.127996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:57.128848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:57.129132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:57.129414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:57.131379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:57.205404 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:57.207240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:57.223329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ddd-7553-4dd5-bb0a-fd246c9093bc admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:57.234366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:57.236317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f080d0-d56b-49fd-9648-9fb7f465a83c service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:57.241226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:57.242889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:57.242889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:57.242889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:57.244351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:57.253451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1128/2271] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:35:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:35:57.262515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:57.263971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:57.275373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1144/2272] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:35:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:35:58.007932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:58.011105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:58.011105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:58.040738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] MFA Rules not processed for user `fc016a84e19c4e8eba776239372fc198`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:35:58.042292 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:58.137870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1129/2273] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:35:58.148967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:35:58.150539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:35:58.165975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5ac64-9b25-41ec-bb91-6aa7a8d42c67 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:35:58.172597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:35:58.173260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:35:58.173685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:35:58.174089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:35:58.237226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:35:58.239129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944acc1-bc84-4783-b133-913c2eb0fab2 service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:35:58.250040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1145/2274] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:35:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:00.673085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:00.673618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:00.800378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4c3eb-a628-498c-b251-0f36e5d7c572 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:00.807028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:00.807570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:00.807871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:00.808141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:00.813759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:00.919296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:00.920780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:00.939377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1130/2275] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:01.864403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:01.864948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:01.865169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:01.885119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] MFA Rules not processed for user `dbfc5ac653fa4809a732bdef3b43a8be`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:01.886921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:01.905816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1146/2276] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:16.726970 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:16.739309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3762029-86cb-4980-81ea-ada60e25fd8e service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:16.744927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:16.745572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:16.745914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:16.746233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:16.748011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:16.759817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:16.761413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:16.772130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1131/2277] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:17.101159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:17.102743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:17.127961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412cec6-be3f-4c86-be8c-c94217aa2e8d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:17.134880 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:17.135776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:17.136243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:17.136522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:17.139355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:17.200369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:17.202001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66deb-6b90-4d10-ab97-dd1cc192e55d service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:17.211411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1147/2278] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:18.369275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:18.378389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b033d25-4247-49d8-bb6f-337d34368ca2 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:18.382107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:18.382744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:18.383027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:18.383320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:18.385170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:18.449797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:18.451071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:18.460679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1132/2279] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:18.542195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:18.542610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:18.542793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:18.562048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] MFA Rules not processed for user `556f14d079254d7e91fc1e942e2a30a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:18.563315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:18.572624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1148/2280] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:19.299875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:19.301270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:19.370188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a3de-8634-4e2e-b81e-c127ba8a3924 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:19.375833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:19.376480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:19.376758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:19.377028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:19.378899 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:19.391562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:19.393172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:19.403926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1133/2281] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:19.964321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:19.976760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f857053-1a24-4b45-982d-9ee47229c439 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:19.981305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:19.982236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:19.982722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:19.983067 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:19.985062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:20.002050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:20.003759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:20.017761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1149/2282] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:22.803906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:22.814255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc322-2b05-4568-b5a1-addebca64c10 service placement] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:22.818174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:22.818941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:22.819323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:22.819719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:22.823294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:22.840892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:22.847631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:22.867477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1134/2283] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:22.943916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:22.946057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:22.976749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c2c4a-59f8-4d28-89f1-3c7cb1955f68 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:22.994411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:22.994411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:22.994411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:22.994411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] PATH_INFO: `/v3/users/d7dc29e12afd4eccb3a311ebaa3061ea` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:22.994920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dc29e12afd4eccb3a311ebaa3061ea)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:22.995540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:23.230014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dc29e12afd4eccb3a311ebaa3061ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.241031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dc29e12afd4eccb3a311ebaa3061ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.252927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dc29e12afd4eccb3a311ebaa3061ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.253579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dc29e12afd4eccb3a311ebaa3061ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.318140 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-82f08f90-9ea4-4880-a0df-38c7c76b7a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dc29e12afd4eccb3a311ebaa3061ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.325039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1150/2284] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:22 2022] DELETE /identity/v3/users/d7dc29e12afd4eccb3a311ebaa3061ea => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:23.641406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:23.660806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b096-97c4-4593-9b68-c6799f17519d service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:23.735393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:23.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:23.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:23.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] PATH_INFO: `/v3/projects/6750a1abb76a492a97a64e85a17b7237` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:23.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6750a1abb76a492a97a64e85a17b7237)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:23.740934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:23.856100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6750a1abb76a492a97a64e85a17b7237', 'request_id': 'req-0b389652-eef2-4bf4-85c7-026e188a4625'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.861376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6750a1abb76a492a97a64e85a17b7237', 'request_id': 'req-0b389652-eef2-4bf4-85c7-026e188a4625'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.940914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6750a1abb76a492a97a64e85a17b7237', 'request_id': 'req-0b389652-eef2-4bf4-85c7-026e188a4625'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.958707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] The token cache is being invalidate because project 6750a1abb76a492a97a64e85a17b7237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:23.958707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.960098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0b389652-eef2-4bf4-85c7-026e188a4625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:23.966006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1135/2285] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:23 2022] DELETE /identity/v3/projects/6750a1abb76a492a97a64e85a17b7237 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:23.967855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:23.968810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:23.968994 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.018910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:24.020304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:24.110899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1151/2286] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:24.111638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.111996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.112284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.136286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:24.138604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:24.150830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1136/2287] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:24.155047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.168087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7e62b-f8eb-452b-ac93-ec455fa792e7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.173537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.174681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.175330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.175971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.177234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:24.177732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.179661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.197758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1152/2288] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:36:24.202911 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.212264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023acee-5dd7-428f-89e2-842340a307aa None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.217452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.218143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.218429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.218704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.219399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.221361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.379030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1137/2289] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:24 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:24.384339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.394609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9dc83-ec91-4198-8c81-ff6ed7ec55db admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.463685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.470997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.470997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.470997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.470997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.470997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.579858 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1153/2290] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:24 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:24.581122 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.592154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a61a-125b-436b-9395-1b6acc933724 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.596831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.597584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.597974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.598318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.599102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.600766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.611837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1138/2291] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:24.617961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.627760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3d24-b1aa-4468-95b5-368e38b2e6c8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.632310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.632957 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.633236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.633509 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.634255 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.635864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc572a-66b9-4417-922f-a5fedbf50827 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.645541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1154/2292] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:24.649756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.660340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc146ebb-2ead-46dc-8d2f-369b34f7e9d4 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.665772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.666680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.666958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.667231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] PATH_INFO: `/v3/projects/d3d8f2c1451d4381862a20a9125f45b1/users/1263ad6cadca4111a7ab0664460b7908/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.682600 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d8f2c1451d4381862a20a9125f45b1, user_id=1263ad6cadca4111a7ab0664460b7908, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:24.685312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:24.776586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1139/2293] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:24 2022] PUT /identity/v3/projects/d3d8f2c1451d4381862a20a9125f45b1/users/1263ad6cadca4111a7ab0664460b7908/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:24.787348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.787643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.788478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:24.816161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] MFA Rules not processed for user `1263ad6cadca4111a7ab0664460b7908`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:24.816824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:24.885923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1155/2294] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:24.896803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:24.898671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:24.988162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebeb81-6f02-4c95-a65c-fc224cc1410d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:24.996442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:24.997547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:24.998051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:24.998488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:25.010806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:25.012775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:25.023221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1140/2295] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:28.907722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:28.920693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b4ea7-6412-46bc-b2ec-a2c5eeac703d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:28.926275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:28.926924 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:28.927202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:28.927473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:28.929227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:28.942122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:28.943797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf497b-c5c5-409f-a7dd-4a820b332cbf service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:28.959542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1156/2296] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:33.457815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:33.518504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6720-c22c-45f9-8ee9-c304b3df3ee6 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:33.522935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:33.523798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:33.524080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:33.524352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] PATH_INFO: `/v3/users/1263ad6cadca4111a7ab0664460b7908` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:33.525545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1263ad6cadca4111a7ab0664460b7908)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:33.527511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:33.735807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1263ad6cadca4111a7ab0664460b7908'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:33.742447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1263ad6cadca4111a7ab0664460b7908'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:33.815698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1263ad6cadca4111a7ab0664460b7908'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:33.828674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1263ad6cadca4111a7ab0664460b7908'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:33.829372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1263ad6cadca4111a7ab0664460b7908'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:33.835791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1141/2297] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:33 2022] DELETE /identity/v3/users/1263ad6cadca4111a7ab0664460b7908 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:33.841012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:33.841487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:33.841584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:33.860046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:33.861230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:33.921905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1157/2298] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:33.931691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:33.933218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:34.004613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e8f8-4b05-42a9-9278-8e5fd1b6d160 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:34.008849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:34.009526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:34.009848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:34.010121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:34.021468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:34.022975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1eff8-49b7-4c8b-8dd4-803f537339c7 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:34.034279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1142/2299] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:34.562276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:34.563985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:34.576778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456265-c4b0-4915-bd26-c18beb3f1b1d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:34.581617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:34.582513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:34.582793 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:34.583059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] PATH_INFO: `/v3/projects/d3d8f2c1451d4381862a20a9125f45b1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:34.584272 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d8f2c1451d4381862a20a9125f45b1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:34.586362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:34.726611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d8f2c1451d4381862a20a9125f45b1', 'request_id': 'req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:34.732852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d8f2c1451d4381862a20a9125f45b1', 'request_id': 'req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:34.739406 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d8f2c1451d4381862a20a9125f45b1', 'request_id': 'req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:34.843120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] The token cache is being invalidate because project d3d8f2c1451d4381862a20a9125f45b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:34.843779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:34.844283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8c1d5686-5f0b-4d52-b0eb-f8901f20da35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:34.845984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1158/2300] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:34 2022] DELETE /identity/v3/projects/d3d8f2c1451d4381862a20a9125f45b1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:34.850988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:34.851498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:34.851787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:34.874623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:34.875847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:34.934631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1143/2301] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:34.942512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:34.942875 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:34.943160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:34.961074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:34.962311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:34.970824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1159/2302] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:34.975214 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:34.985576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9735e-1d47-4bef-8db4-93a078249230 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:34.990315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:34.993785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:34.993785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:34.993785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:34.993785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:34.993785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:34.994278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.006619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1144/2303] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:36:35.011003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.020390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0143c7-fd47-45d7-be4c-5992b2c788d0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.025183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.025788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.026071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.026345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.027065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.029073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.120094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1160/2304] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:35 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:35.124039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.133964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7577-88a8-47e3-970a-2d3552a89ba2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.193819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.194490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.194774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.195052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.195749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.197863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.381367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1145/2305] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:35 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:35.385459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.396088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e69-63c6-41c8-a6d7-31f6705fee54 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.400795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.401569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.402429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.402707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.403450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.405099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.418971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1161/2306] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:35.420146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.429880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40ecb-e746-48d5-b86d-2e4a69572dd9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.434396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.435047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.435331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.435603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.436315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.437942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cbd35-3742-4279-9abd-574d282d34ee admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.447846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1146/2307] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:35.452248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.463679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13475f6-c00d-422f-9262-06d46badb965 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.469147 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.470058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.470342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.470618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] PATH_INFO: `/v3/projects/07ed6d5009c1475599d70264305b299d/users/49b5d61c1ca9459cb1459eccdc250db2/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.484557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ed6d5009c1475599d70264305b299d, user_id=49b5d61c1ca9459cb1459eccdc250db2, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.487259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.582077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1162/2308] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:35 2022] PUT /identity/v3/projects/07ed6d5009c1475599d70264305b299d/users/49b5d61c1ca9459cb1459eccdc250db2/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:35.594560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.594978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.595350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.641701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] MFA Rules not processed for user `49b5d61c1ca9459cb1459eccdc250db2`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:35.643204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:35.733048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1147/2309] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:35.747708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.843420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0b8c-858b-42df-afe8-fc31a61b4cca admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:35.849357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:35.850046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:35.850354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:35.850579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:35.851362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:35.853514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:35.964231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1163/2310] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:35 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:35.968499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:35.987353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacf29d-1af4-4424-80c5-bfc2420a7a6b None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.052109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.052783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.053064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.053335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.054097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.056032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.158660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1148/2311] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:35 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:36.163251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.174287 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1904d-7c57-4d33-a748-0268be0b5914 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.179112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.179910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.184297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.184297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.184297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.184297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.198381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1164/2312] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:36.202086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.216958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1284fe-0c89-44ae-8fcc-9f7f124463c1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.224348 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.226211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.226696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.227156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] PATH_INFO: `/v3/projects/c1f89b490e1748fb885423b94810e777/users/0a5cc8661b614d19851a1eaeb329474e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.248807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f89b490e1748fb885423b94810e777, user_id=0a5cc8661b614d19851a1eaeb329474e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.253698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.337621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1149/2313] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:36 2022] PUT /identity/v3/projects/c1f89b490e1748fb885423b94810e777/users/0a5cc8661b614d19851a1eaeb329474e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:36.350002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.356568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ca72-94e7-4295-8022-ae01788431a8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.482742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.483587 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.483970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.484346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.485223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.488465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302dd81-50c6-4696-898e-6d9c308a6435 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.524627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.533572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1165/2314] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:36.540602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d414e7f-9a68-4d20-bdb1-8046342a4c9c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.554694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.554694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.554694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.554694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] PATH_INFO: `/v3/projects/c1f89b490e1748fb885423b94810e777/users/0a5cc8661b614d19851a1eaeb329474e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.555077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f89b490e1748fb885423b94810e777, user_id=0a5cc8661b614d19851a1eaeb329474e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.555077 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.578353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.578705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.579050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.589880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1150/2315] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:36 2022] PUT /identity/v3/projects/c1f89b490e1748fb885423b94810e777/users/0a5cc8661b614d19851a1eaeb329474e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:36.608577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] MFA Rules not processed for user `0a5cc8661b614d19851a1eaeb329474e`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:36.609916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:36.704149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1166/2316] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:36.706162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.708094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:36.785580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e304-c6f7-43bd-b2b1-b82690788693 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.789167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.790072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.790222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.790373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:36.800896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:36.802413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:36.814357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1151/2317] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:36.974576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:36.976196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:36.989931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55407a-d317-4f49-b0f4-6f6c1dd1e1da None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:36.993710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:36.994390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:36.994669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:36.994939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:37.071732 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:37.073182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad1f20-2919-4631-88b8-8abc5483d465 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:37.082635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1167/2318] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:37.850677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:37.852137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:37.928044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c691-485e-4bdb-ac7c-f628344f9bb9 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:37.934101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:37.934737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:37.935020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:37.935289 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:37.937039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:37.949877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:37.951497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:37.964746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1152/2319] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:39.208964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:39.209419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:39.209513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:39.226445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:39.227614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:39.280123 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1168/2320] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:39.522688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:39.524232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:39.602762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f8e6-562d-464e-8f3c-de2f5ff4cbb0 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:39.608380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:39.609015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:39.609293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:39.609561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:39.617913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:39.619500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:39.627607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1153/2321] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:36:40.288928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:40.290417 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:40.345304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fd375-baeb-4655-a0d1-218e63c7be78 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:40.348848 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:40.349517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:40.349828 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:40.350097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:40.351938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:40.412023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:40.413420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700190df-fbb1-475f-8c70-0508ee1f2b6b service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:40.423008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1169/2322] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:42.318424 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:42.386550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfa59-9982-42fc-93ef-f117f1e54c7d service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:42.392635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:42.393515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:42.393837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:42.394111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] PATH_INFO: `/v3/users/49b5d61c1ca9459cb1459eccdc250db2` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:42.395337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b5d61c1ca9459cb1459eccdc250db2)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:42.397318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:42.643621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b5d61c1ca9459cb1459eccdc250db2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:42.652623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b5d61c1ca9459cb1459eccdc250db2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:42.764010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b5d61c1ca9459cb1459eccdc250db2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:42.786788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b5d61c1ca9459cb1459eccdc250db2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:42.787633 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b5d61c1ca9459cb1459eccdc250db2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:42.797792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1154/2323] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:42 2022] DELETE /identity/v3/users/49b5d61c1ca9459cb1459eccdc250db2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:42.802653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:42.803174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:42.803367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:42.838625 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:42.840466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:43.001757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1170/2324] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:43.019678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:43.022566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:43.143688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2636c8-b511-4228-9733-70f50bef674a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:43.153135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:43.153724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:43.154013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:43.154288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:43.164744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:43.166338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:43.185362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1155/2325] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:43.911816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:43.913365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:43.926095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed963621-22ec-4266-a640-a6fef67153ee None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:43.931069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:43.932443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:43.932443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:43.932618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] PATH_INFO: `/v3/projects/07ed6d5009c1475599d70264305b299d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:43.933923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ed6d5009c1475599d70264305b299d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:43.935870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:44.087814 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ed6d5009c1475599d70264305b299d', 'request_id': 'req-8811bdfa-ccb0-4134-836a-166c77eee064'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.094102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ed6d5009c1475599d70264305b299d', 'request_id': 'req-8811bdfa-ccb0-4134-836a-166c77eee064'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.100366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ed6d5009c1475599d70264305b299d', 'request_id': 'req-8811bdfa-ccb0-4134-836a-166c77eee064'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.119824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:44.121911 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:44.199572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6c20-7c66-4016-9394-61a85ebd694d service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:44.227419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] The token cache is being invalidate because project 07ed6d5009c1475599d70264305b299d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:44.232820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.232820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.234180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1171/2326] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:43 2022] DELETE /identity/v3/projects/07ed6d5009c1475599d70264305b299d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:44.236270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:44.238237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:44.270512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:44.271962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:44.272350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:44.272731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:44.274684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:44.321415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bdfa-ccb0-4134-836a-166c77eee064 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:44.330544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:44.331672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:44.332951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:44.333239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] PATH_INFO: `/v3/users/0a5cc8661b614d19851a1eaeb329474e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:44.334543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5cc8661b614d19851a1eaeb329474e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:44.336667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:44.353175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:44.355620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:44.377126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1156/2327] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:36:44.570074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5cc8661b614d19851a1eaeb329474e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.581596 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5cc8661b614d19851a1eaeb329474e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.599807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5cc8661b614d19851a1eaeb329474e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.600550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5cc8661b614d19851a1eaeb329474e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.682908 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-ca45ab4e-543d-4f75-9462-f1554db77042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5cc8661b614d19851a1eaeb329474e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:44.689612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1172/2328] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:44 2022] DELETE /identity/v3/users/0a5cc8661b614d19851a1eaeb329474e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:45.268208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:45.279195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97198c3-3e1f-4a62-a725-9e8b619c4b79 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:45.334965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:45.335822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.336102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.336370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] PATH_INFO: `/v3/projects/c1f89b490e1748fb885423b94810e777` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.337576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f89b490e1748fb885423b94810e777)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:45.339526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:45.471112 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f89b490e1748fb885423b94810e777', 'request_id': 'req-6085c00f-09f0-4b49-8b19-07d25a33e62d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:45.476783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f89b490e1748fb885423b94810e777', 'request_id': 'req-6085c00f-09f0-4b49-8b19-07d25a33e62d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:45.556900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f89b490e1748fb885423b94810e777', 'request_id': 'req-6085c00f-09f0-4b49-8b19-07d25a33e62d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:45.569209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] The token cache is being invalidate because project c1f89b490e1748fb885423b94810e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:45.569494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:45.570341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-6085c00f-09f0-4b49-8b19-07d25a33e62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:45.571869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1157/2329] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:45 2022] DELETE /identity/v3/projects/c1f89b490e1748fb885423b94810e777 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:45.576743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.577256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.577387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.595132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:45.596350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:45.654786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1173/2330] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:45.663650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.663940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.664216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.683113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:45.685238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:45.692529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1158/2331] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:45.697304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:45.706926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987f13-c95d-4c27-97f5-8c7deaced8db None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:45.711607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:45.712263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.712538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.712805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.713573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:45.714358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:45.719464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:45.732441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1174/2332] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:36:45.733316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:45.742867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b46eb-4eec-463b-9d0b-7a843acea996 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:45.747716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:45.748369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.748651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.748977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.749731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:45.751716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:45.860509 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1159/2333] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:45 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:45.861479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:45.871160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c700dc-7404-4e5c-8ed6-bae76b4bb8d8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:45.928352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:45.929018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:45.929301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:45.929606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:45.930376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:45.932340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.049854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1175/2334] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:45 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:46.053940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.063975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2685-6321-4078-b1ab-c2e894b9820b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.068484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.069121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.069400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.069692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.070480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.072068 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.082529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1160/2335] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:46.090863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.101070 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87b4bc-85ca-4807-97e7-722404964bdb admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.106064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.106778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.107063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.107369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.108082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.109727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed25d-436d-4469-bf8f-7e7c0c7c4dab admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.120703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1176/2336] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:46.124894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.135072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d04a7-a53f-439f-97b6-cf4d6a59580f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.140120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.140983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.141259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.141543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] PATH_INFO: `/v3/projects/1c953eba44a3403f9d59fe065a2cebf1/users/3547f56d78c24d6e9763f32587720cb1/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.160993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c953eba44a3403f9d59fe065a2cebf1, user_id=3547f56d78c24d6e9763f32587720cb1, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.163753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.269126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1161/2337] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:46 2022] PUT /identity/v3/projects/1c953eba44a3403f9d59fe065a2cebf1/users/3547f56d78c24d6e9763f32587720cb1/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:46.280212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.280795 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.281230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.316118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] MFA Rules not processed for user `3547f56d78c24d6e9763f32587720cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:46.317261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:46.388602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1177/2338] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:46.393101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.452420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28ff0-8187-4b17-8630-351f1dc1d535 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.457585 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.458252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.458644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.458937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.459593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.461822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.554370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1162/2339] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:46 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:46.558938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.570187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66571d-1259-4542-865b-b5d29e29ceae None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.628644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.629309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.629579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.629888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.630584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.632557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.770890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1178/2340] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:46 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:46.774192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.785474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118534cf-2c4d-4c72-9c1d-54196a1fd6c4 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.790485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.791322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.791752 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.792842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.793606 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.795389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.809709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1163/2341] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:46.811459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.822589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4791a-1a7e-415c-8df3-9ee1c3c7fa38 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:46.828152 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:46.829242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:46.829597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:46.830071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] PATH_INFO: `/v3/projects/c47ded9283e04673afc0e39c7f6be16d/users/8c39f323b99c428baddf85a5caf1f699/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:46.846304 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47ded9283e04673afc0e39c7f6be16d, user_id=8c39f323b99c428baddf85a5caf1f699, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:46.849170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:46.947250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1179/2342] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:46 2022] PUT /identity/v3/projects/c47ded9283e04673afc0e39c7f6be16d/users/8c39f323b99c428baddf85a5caf1f699/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:46.951284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:46.966297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203bc95-cac4-44dd-ae43-1bf945a552bc admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:47.037817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:47.037817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.037817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.037817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.038237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:47.038237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642d45-ff3e-409a-a7e1-bd1906deee68 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:47.047795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1164/2343] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:47.049251 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:47.062566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198182f0-6314-4cb6-93ef-2822c20aecad admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:47.067422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:47.068302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.068727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.069003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] PATH_INFO: `/v3/projects/c47ded9283e04673afc0e39c7f6be16d/users/8c39f323b99c428baddf85a5caf1f699/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.071164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47ded9283e04673afc0e39c7f6be16d, user_id=8c39f323b99c428baddf85a5caf1f699, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:47.078012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:47.085707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1180/2344] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:47 2022] PUT /identity/v3/projects/c47ded9283e04673afc0e39c7f6be16d/users/8c39f323b99c428baddf85a5caf1f699/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:47.096831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.097114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.097393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.127302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] MFA Rules not processed for user `8c39f323b99c428baddf85a5caf1f699`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:47.128522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:47.206751 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1165/2345] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:47.220458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:47.222475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:47.287817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955135b-2cfd-41dd-b325-fd9ab0990c47 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:47.291909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:47.297173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.297173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.297173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.305558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:47.307165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144df24-6357-40f5-b857-ac4c0be9463f service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:47.316920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1181/2346] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:47.383763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:47.448145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7afb-cd1c-42e1-ab84-99e82465caa9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:47.453577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:47.454477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.454759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.455100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] PATH_INFO: `/v3/users/3547f56d78c24d6e9763f32587720cb1` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.456427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3547f56d78c24d6e9763f32587720cb1)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:47.458636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:47.630832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3547f56d78c24d6e9763f32587720cb1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:47.639287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3547f56d78c24d6e9763f32587720cb1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:47.723698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3547f56d78c24d6e9763f32587720cb1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:47.739413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3547f56d78c24d6e9763f32587720cb1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:47.740117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3547f56d78c24d6e9763f32587720cb1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:47.746590 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1166/2347] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:47 2022] DELETE /identity/v3/users/3547f56d78c24d6e9763f32587720cb1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:47.751252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.751749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.751861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.770188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:47.771372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:47.831461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1182/2348] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:47.841797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:47.843363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:47.902126 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ac6ae-f823-4203-a437-a1493c265756 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:47.905818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:47.906453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:47.906732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:47.907002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:47.915865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:47.917397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:47.926698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1167/2349] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:48.492695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:48.498826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:48.516052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413655-4592-44a5-b182-9ce47ff1d5c5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:48.524389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:48.525533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:48.525865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:48.526136 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] PATH_INFO: `/v3/projects/1c953eba44a3403f9d59fe065a2cebf1` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:48.527382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c953eba44a3403f9d59fe065a2cebf1)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:48.529316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:48.695511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c953eba44a3403f9d59fe065a2cebf1', 'request_id': 'req-720c579c-e8b6-44e5-b343-a7f00e5b51d3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:48.702101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c953eba44a3403f9d59fe065a2cebf1', 'request_id': 'req-720c579c-e8b6-44e5-b343-a7f00e5b51d3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:48.711100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c953eba44a3403f9d59fe065a2cebf1', 'request_id': 'req-720c579c-e8b6-44e5-b343-a7f00e5b51d3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:48.803360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] The token cache is being invalidate because project 1c953eba44a3403f9d59fe065a2cebf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:48.803995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:48.804337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:48.806483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1183/2350] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:48 2022] DELETE /identity/v3/projects/1c953eba44a3403f9d59fe065a2cebf1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:48.811202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:48.820735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008f115-346e-43c8-8bed-6604b1193373 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:48.878614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:48.879486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:48.879907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:48.880029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] PATH_INFO: `/v3/users/8c39f323b99c428baddf85a5caf1f699` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:48.881191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c39f323b99c428baddf85a5caf1f699)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:48.883159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:49.001054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:49.002663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:49.017065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c579c-e8b6-44e5-b343-a7f00e5b51d3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:49.021818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:49.022677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:49.022961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:49.023234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] PATH_INFO: `/v3/users/1fa24f91bca34d949b0f25bb4388e3a4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:49.024420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa24f91bca34d949b0f25bb4388e3a4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:49.026402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:49.132294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c39f323b99c428baddf85a5caf1f699'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.140409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c39f323b99c428baddf85a5caf1f699'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.232521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c39f323b99c428baddf85a5caf1f699'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.244982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c39f323b99c428baddf85a5caf1f699'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.247903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c39f323b99c428baddf85a5caf1f699'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.252083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1168/2351] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:48 2022] DELETE /identity/v3/users/8c39f323b99c428baddf85a5caf1f699 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:49.280547 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa24f91bca34d949b0f25bb4388e3a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.287836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa24f91bca34d949b0f25bb4388e3a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.301595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa24f91bca34d949b0f25bb4388e3a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.305267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa24f91bca34d949b0f25bb4388e3a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.386655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa24f91bca34d949b0f25bb4388e3a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:49.393054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1184/2352] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:48 2022] DELETE /identity/v3/users/1fa24f91bca34d949b0f25bb4388e3a4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:49.752905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:49.754375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:49.787076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:49.789972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:49.846439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ecdf5-d64e-451b-b64a-52ff02f7c607 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:49.884292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67779696-35ff-473b-9e29-a04fcc52ca79 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:49.889639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:49.890535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:49.890818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:49.891095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] PATH_INFO: `/v3/projects/8fcb2a54095042de8f8a080ac25139a8` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:49.892292 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcb2a54095042de8f8a080ac25139a8)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:49.894286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:49.906711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:49.907573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:49.910689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:49.910689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] PATH_INFO: `/v3/projects/c47ded9283e04673afc0e39c7f6be16d` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:49.910689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47ded9283e04673afc0e39c7f6be16d)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:49.911724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.009271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcb2a54095042de8f8a080ac25139a8', 'request_id': 'req-8d8ea245-16f2-4621-9d31-be798e2394ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.015231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcb2a54095042de8f8a080ac25139a8', 'request_id': 'req-8d8ea245-16f2-4621-9d31-be798e2394ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.021511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcb2a54095042de8f8a080ac25139a8', 'request_id': 'req-8d8ea245-16f2-4621-9d31-be798e2394ea'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.080357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47ded9283e04673afc0e39c7f6be16d', 'request_id': 'req-28b91175-195d-4306-ba24-c8066cf5c15c'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.086063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47ded9283e04673afc0e39c7f6be16d', 'request_id': 'req-28b91175-195d-4306-ba24-c8066cf5c15c'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.111278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] The token cache is being invalidate because project 8fcb2a54095042de8f8a080ac25139a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:50.111567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.112178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.113776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1185/2353] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:49 2022] DELETE /identity/v3/projects/8fcb2a54095042de8f8a080ac25139a8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:50.117708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.119044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:50.180670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ea245-16f2-4621-9d31-be798e2394ea admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.209342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47ded9283e04673afc0e39c7f6be16d', 'request_id': 'req-28b91175-195d-4306-ba24-c8066cf5c15c'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.221278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] The token cache is being invalidate because project c47ded9283e04673afc0e39c7f6be16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:50.221681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.222326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-28b91175-195d-4306-ba24-c8066cf5c15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.224083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1169/2354] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:49 2022] DELETE /identity/v3/projects/c47ded9283e04673afc0e39c7f6be16d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:50.228443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42465-df68-40fa-b665-1697eaa7318d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.228731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42465-df68-40fa-b665-1697eaa7318d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.229002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b42465-df68-40fa-b665-1697eaa7318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.237135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.238056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.238338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.238613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] PATH_INFO: `/v3/users/dc865dc47a3648be879c835efd2fa9e4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.239829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc865dc47a3648be879c835efd2fa9e4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.241835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.247366 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-07b42465-df68-40fa-b665-1697eaa7318d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:50.248566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-07b42465-df68-40fa-b665-1697eaa7318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:50.257386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1170/2355] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:50.267065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.267357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.267622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.287692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:50.288888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:50.296846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1171/2356] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:50.300996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.310913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85a40e-e410-4b02-bda1-f9d59073a2c9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.315523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.316171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.316457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.316729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.317445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:50.317783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.319413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.331954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1172/2357] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:36:50.336733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.346964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77441937-b72f-46c2-8376-e4ac8d463816 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.351588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.352225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.352505 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.352777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.353458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.355551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.484385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1173/2358] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:50 2022] POST /identity/v3/projects => generated 359 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:50.488470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.519121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc865dc47a3648be879c835efd2fa9e4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.525815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc865dc47a3648be879c835efd2fa9e4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.537252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc865dc47a3648be879c835efd2fa9e4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.539044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc865dc47a3648be879c835efd2fa9e4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.548109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3196-6a4a-4a55-83bb-633b99285a2e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.552778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.553432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.553745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.554019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.554692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.556698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.626707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc865dc47a3648be879c835efd2fa9e4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:50.632959 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1186/2359] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:50 2022] DELETE /identity/v3/users/dc865dc47a3648be879c835efd2fa9e4 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:50.672898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1174/2360] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:50 2022] POST /identity/v3/users => generated 280 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:50.676997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.678379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:50.744046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7988-c5df-4d16-b0d5-cf556acbb9c8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.749359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.750057 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.750340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.750616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.751336 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.752945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.763033 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1187/2361] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:50.766971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.780602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7264c6-06d0-45c7-9f8a-94b3133e8ab7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.785897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.786562 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.786844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.787117 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.787861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.789462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.799914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1175/2362] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:50.804277 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.815206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3e5d-76c0-455c-bac5-c65f461c1ba1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.819873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.820737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.821018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.821290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] PATH_INFO: `/v3/projects/06ef66afa91c497f8d435c27f322da96/users/39ead0b2e4a54a5ba99e0b6f76bcb71f/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.835993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ef66afa91c497f8d435c27f322da96, user_id=39ead0b2e4a54a5ba99e0b6f76bcb71f, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.838886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296623f-ac04-4d8d-856a-6a898e58a13d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.902987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:50.904757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:50.921612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985dab-89a0-40ef-bdc9-263926a70133 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:50.927250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:50.928187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.928469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.928741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] PATH_INFO: `/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:50.930062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1cef3eb75e42ee8239eeee32937fd8)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:50.932024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:50.963720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1188/2363] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:50 2022] PUT /identity/v3/projects/06ef66afa91c497f8d435c27f322da96/users/39ead0b2e4a54a5ba99e0b6f76bcb71f/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:50.974869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:50.975154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:50.975424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.001321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] MFA Rules not processed for user `39ead0b2e4a54a5ba99e0b6f76bcb71f`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:51.002562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.062528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1189/2364] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:51.085360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1cef3eb75e42ee8239eeee32937fd8', 'request_id': 'req-5fbf36e0-8840-4e75-8838-0ede0759390a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.085360 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1cef3eb75e42ee8239eeee32937fd8', 'request_id': 'req-5fbf36e0-8840-4e75-8838-0ede0759390a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.096779 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.098206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.153868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058a6b-eb2f-4a60-ac3f-87943e473e94 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.190971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1cef3eb75e42ee8239eeee32937fd8', 'request_id': 'req-5fbf36e0-8840-4e75-8838-0ede0759390a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.203188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.203930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.204092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] The token cache is being invalidate because project dc1cef3eb75e42ee8239eeee32937fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:51.204345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.204635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.204773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.205440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5fbf36e0-8840-4e75-8838-0ede0759390a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.206781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.207173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1176/2365] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:50 2022] DELETE /identity/v3/projects/dc1cef3eb75e42ee8239eeee32937fd8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:51.212031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020dd5e-5cc6-4553-bd13-c274552239d6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.212585 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020dd5e-5cc6-4553-bd13-c274552239d6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.212964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020dd5e-5cc6-4553-bd13-c274552239d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.232906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1020dd5e-5cc6-4553-bd13-c274552239d6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:51.234309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1020dd5e-5cc6-4553-bd13-c274552239d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.267176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.268632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.277964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1190/2366] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:36:51.291623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.293010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.310347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1177/2367] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:51.317966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.318191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.318469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.336234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:51.337421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.346419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1178/2368] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:51.350427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.356282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b28c6-32d2-49bc-9133-a9d2c146c83b service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.359184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736b048-441d-45b3-8976-957d2d74af8f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.360865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.362438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.362721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.362995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] PATH_INFO: `/v3/users/39ead0b2e4a54a5ba99e0b6f76bcb71f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.363828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.364219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ead0b2e4a54a5ba99e0b6f76bcb71f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.364460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.364738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.365007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.365734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:51.366041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.366223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.367632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.379005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1179/2369] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:36:51.383293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.393143 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc466b5-1724-448c-af66-4fb1c8ea8f98 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.397978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.398616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.398925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.404193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.404193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.404193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.525727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1180/2370] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:51.530343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.591580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957d3e3-71d6-4561-a715-5af8b18133eb admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.596269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.597031 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.597291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.597491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.598193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.600287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.620549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ead0b2e4a54a5ba99e0b6f76bcb71f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.627721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ead0b2e4a54a5ba99e0b6f76bcb71f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.639681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ead0b2e4a54a5ba99e0b6f76bcb71f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.640364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ead0b2e4a54a5ba99e0b6f76bcb71f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.688293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1181/2371] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:51.692277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.693897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.705884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba203-21b3-4aee-84a4-728b958e5628 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.710471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.711081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.711359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.711627 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.712325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.713916 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.716469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-44db235b-ee8e-46fd-86a4-c060421061b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ead0b2e4a54a5ba99e0b6f76bcb71f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:51.722788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1191/2372] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:36:51 2022] DELETE /identity/v3/users/39ead0b2e4a54a5ba99e0b6f76bcb71f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:51.723947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1182/2373] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:51.727362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.727502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.727646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.727925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.737233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762824-7a01-4c43-9361-b7038cd33842 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.744281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:51.745567 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.793141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.793849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.794132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.794405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.795113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.796797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.803339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1192/2374] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:51.806669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1183/2375] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:51.811279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.814002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:51.815687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:51.820708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50143e2b-3b9f-4b8f-9ddb-a511db109431 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.825883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.826752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.827027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.827294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] PATH_INFO: `/v3/projects/128b813a50464f31b257ffac581ed332/users/384b83917c9a4766b0117de6e71942ba/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.841606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128b813a50464f31b257ffac581ed332, user_id=384b83917c9a4766b0117de6e71942ba, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.844386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.870965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be9987-9a72-4ac3-9db3-079a677c70ec admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:51.875443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:51.876083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.876386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.876702 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.885898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:51.887341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7b43-f637-4407-8b68-96f7246cc1e8 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:51.897695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1184/2376] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:36:51.946721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1193/2377] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:51 2022] PUT /identity/v3/projects/128b813a50464f31b257ffac581ed332/users/384b83917c9a4766b0117de6e71942ba/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:51.951798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:51.952269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:51.952393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:51.991205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:51.992414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:52.050469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1185/2378] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:52.060528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:52.062373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:52.117686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055690a-5de6-4f1a-bb5d-f563d97542a5 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:52.121335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:52.122664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:52.122946 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:52.123219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:52.132381 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:52.133955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564ac79-22c8-4681-be49-dde0aadf2568 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:52.143368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1194/2379] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:52.383892 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:52.385273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:52.397178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601239-7770-4b7d-96f4-2faf06b7d569 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:52.402221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:52.403062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:52.403873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:52.404145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] PATH_INFO: `/v3/projects/06ef66afa91c497f8d435c27f322da96` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:52.405310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ef66afa91c497f8d435c27f322da96)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:52.407257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:52.547427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ef66afa91c497f8d435c27f322da96', 'request_id': 'req-9398e44c-8018-49fa-9955-6d00c6ad5954'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:52.552750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ef66afa91c497f8d435c27f322da96', 'request_id': 'req-9398e44c-8018-49fa-9955-6d00c6ad5954'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:52.701674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ef66afa91c497f8d435c27f322da96', 'request_id': 'req-9398e44c-8018-49fa-9955-6d00c6ad5954'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:52.713390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] The token cache is being invalidate because project 06ef66afa91c497f8d435c27f322da96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:36:52.713692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:52.714398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-9398e44c-8018-49fa-9955-6d00c6ad5954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:36:52.716861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1186/2380] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:36:52 2022] DELETE /identity/v3/projects/06ef66afa91c497f8d435c27f322da96 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:52.721977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:52.724303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:52.724303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:52.741036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:52.742508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:52.805922 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1195/2381] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:52.814727 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:52.814985 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:52.815312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:52.834628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:52.836046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:52.852880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1187/2382] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:52.962480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:52.972854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad1df1-6357-4a24-9417-98fa70840f4d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:52.978062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:52.978735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:52.979214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:52.979662 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:52.980403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:36:52.980733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:52.982977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.019963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1196/2383] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:36:53.021215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.031886 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d1310-d8df-46d1-af86-041d36f64eb9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.037293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.037991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.038306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.038551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.039234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.041176 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.217044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1188/2384] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:53 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:53.221125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.231907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782127ab-b4db-430b-8c6b-eca6e09d3968 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.287536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.288205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.288486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.288760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.289457 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.291492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.446997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1197/2385] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:53 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:53.448259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.459036 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e37a3-d35e-46b8-9735-ef77b765106b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.463549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.464216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.464482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.464756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.465468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.468085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.478950 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1189/2386] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:53.482960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.495415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad5d33-2e7f-4fea-b20e-0cae1b63921a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.500055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.500710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.500987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.501260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.502082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.503588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03499580-2a3d-4cf6-b56f-50e0ceb22e2a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.516616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1198/2387] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:53.520716 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.531720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713df8-ed28-43dd-92e0-da0bdbe0c2da admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.542333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.543283 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.543570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.543846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] PATH_INFO: `/v3/projects/52d5938012604cd1a60026173b17a58b/users/235a4db21e1148268023c006778c1011/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.561926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d5938012604cd1a60026173b17a58b, user_id=235a4db21e1148268023c006778c1011, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.564880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:53.745714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1190/2388] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:53 2022] PUT /identity/v3/projects/52d5938012604cd1a60026173b17a58b/users/235a4db21e1148268023c006778c1011/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:53.757005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.757295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.757826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.786317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] MFA Rules not processed for user `235a4db21e1148268023c006778c1011`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:53.791001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:53.873015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1199/2389] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:36:53.877733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:53.951321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b28028-667e-4f30-ab6d-b00841c6a89a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:53.966730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:53.967496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:53.967787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:53.968370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:53.968838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:53.974819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:54.142914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1191/2390] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:53 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:54.152586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:54.165700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c2d5-931e-471b-a444-a6745a27d425 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:54.265534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:54.267010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.267299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.267577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.268548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:54.270844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:54.373844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1200/2391] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:54 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:54.376734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:54.391475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95065-e96e-4613-ade3-3f1fb383b3e3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:54.398406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:54.401901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.401901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.401901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.401901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:54.402941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:54.419365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1192/2392] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:54.423715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:54.434481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a091-9937-4a4c-a9a2-b20239e0ef58 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:54.440511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:54.441740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.441740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.447940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.447940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:54.447940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4173-6cc0-4366-99ef-ce8a05131b29 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:54.456665 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1201/2393] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:54.463583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:54.477498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df9d2-c487-4398-9ddc-fc4e7e3dd748 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:54.485656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:54.486623 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.486977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.487320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] PATH_INFO: `/v3/projects/26f0780f2c2344278f05da3ae394f41b/users/951c475489c14fea94390e43c697d63b/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.507351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f0780f2c2344278f05da3ae394f41b, user_id=951c475489c14fea94390e43c697d63b, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:54.511583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:54.670325 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1193/2394] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:54 2022] PUT /identity/v3/projects/26f0780f2c2344278f05da3ae394f41b/users/951c475489c14fea94390e43c697d63b/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:54.680599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe155-044f-4297-a350-04fe201ec084 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.680771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe155-044f-4297-a350-04fe201ec084 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.681550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe155-044f-4297-a350-04fe201ec084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.732182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-046fe155-044f-4297-a350-04fe201ec084 None None] MFA Rules not processed for user `951c475489c14fea94390e43c697d63b`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:54.733411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-046fe155-044f-4297-a350-04fe201ec084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:54.821478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1202/2395] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:54.822937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:54.899378 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11a2d-1f3a-4a24-8941-bd657efdf997 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:54.905822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:54.906580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:54.907786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:54.907786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:54.908491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:54.910608 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.063163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1194/2396] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:54 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:55.067275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe155-044f-4297-a350-04fe201ec084 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.078511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe155-044f-4297-a350-04fe201ec084 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.150943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.151696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.151984 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.152257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.153234 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.155440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.272776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1203/2397] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:55 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:55.276849 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.288574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a285-ca8c-4b2b-95a7-0a64938dc58a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.299730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.300514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.300898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.301276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.302141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.303887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.321261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.325249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1195/2398] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:55.341375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d9ca-5cb8-4aa5-9204-5e860a7ab9bc admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.350172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.364822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.364822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.364822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] PATH_INFO: `/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f/users/e74118bbec314c6bafb5ec7d149e6c63/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.385473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4232008d9d4e5992de1e6a6211ea5f, user_id=e74118bbec314c6bafb5ec7d149e6c63, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.392873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.570280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1204/2399] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:55 2022] PUT /identity/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f/users/e74118bbec314c6bafb5ec7d149e6c63/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:36:55.574333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.584164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee854-50cc-4b9e-8a7e-253e6248d42d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.650645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.651335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.651624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.651935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.652651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.654827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9eb9a8-3db6-4ff6-ae63-e31f09de2f22 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.679476 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1196/2400] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:36:55.683391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.695349 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6d87-d92f-4a31-a17d-0131db19c1ec admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.701258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.701893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.702171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.702443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] PATH_INFO: `/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f/users/e74118bbec314c6bafb5ec7d149e6c63/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.704424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4232008d9d4e5992de1e6a6211ea5f, user_id=e74118bbec314c6bafb5ec7d149e6c63, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.707184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:55.718188 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1205/2401] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:55 2022] PUT /identity/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f/users/e74118bbec314c6bafb5ec7d149e6c63/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:36:55.729266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.737857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.737857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.758121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] MFA Rules not processed for user `e74118bbec314c6bafb5ec7d149e6c63`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:55.759333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:55.835124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1197/2402] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:55.846843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:55.848551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:55.907684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cadee9-4ebf-4b23-ab13-84e3e5f50fa2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:55.911377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:55.912026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:55.912303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:55.915622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:55.991610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:55.993176 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8959d93-b774-457f-a97d-2652918de505 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:56.003818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1206/2403] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:58.336311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:58.338355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:58.362404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43415a09-bee8-4c0f-8d28-ee0539c76d4e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:58.366612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:58.367389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:58.367790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:58.368154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:58.445870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:58.447746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:58.461797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1198/2404] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:36:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:36:59.210748 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:59.211221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:59.211316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:59.255236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] MFA Rules not processed for user `384b83917c9a4766b0117de6e71942ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:36:59.256930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:59.378328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1207/2405] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:36:59.381345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:59.381345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:36:59.468322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5b2a-21e0-4861-b92a-7d1eafbf4c0a service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:59.478447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:59.479363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:59.479807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:59.480602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:59.481927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:59.484418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:59.608814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1199/2406] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:36:59 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:36:59.612264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:59.625648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a696-0faa-435a-95c2-f9c1910806e7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:59.695903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:59.696673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:59.697477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:59.697861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:59.698771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:59.701275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:59.791451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1208/2407] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:36:59 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:36:59.795942 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:59.807307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675dc5-4631-4508-91f8-b7c3b92ad6e1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:59.812610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:59.819368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:59.819368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:59.819368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:59.819368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:59.819368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:36:59.828254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1200/2408] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:36:59.832315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:36:59.852110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846d9f-8f9e-44a7-9647-8bad16fab17a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:36:59.854572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:36:59.855464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:36:59.855744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:36:59.856078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] PATH_INFO: `/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c/users/442132987dad4db6a4cec799598c0ad8/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:36:59.874166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb69e82e1f4eb5a5fca454ca905b0c, user_id=442132987dad4db6a4cec799598c0ad8, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:36:59.879351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:00.011872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1209/2409] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:36:59 2022] PUT /identity/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c/users/442132987dad4db6a4cec799598c0ad8/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:00.016002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:00.027521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567197b-ef35-4a59-9851-05562ef4103e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:00.088114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:00.088687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:00.088966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:00.089237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:00.089998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:00.092461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cec6f-5243-424a-af46-005b717940ed admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:00.102304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1201/2410] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:37:00.106862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:00.118437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2090ec-487d-40f5-8d04-5358b889a519 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:00.123327 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:00.124207 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:00.124489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:00.124766 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] PATH_INFO: `/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c/users/442132987dad4db6a4cec799598c0ad8/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:00.126784 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb69e82e1f4eb5a5fca454ca905b0c, user_id=442132987dad4db6a4cec799598c0ad8, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:00.129447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:00.140453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1210/2411] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:37:00 2022] PUT /identity/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c/users/442132987dad4db6a4cec799598c0ad8/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:00.481654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:00.482284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:00.482393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:00.484356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:00.507139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] MFA Rules not processed for user `bbc60b26fb424ad78dc6d86b5da15b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:00.514273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:00.559618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4251b-0123-4df8-82ea-09a623ce4d67 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:00.566472 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:00.567305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:00.567609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:00.567885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:00.602087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1202/2412] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:00.644585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:00.646342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:00.664103 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1211/2413] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:00.963082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:00.964701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:01.030389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2351e6-3b27-4f6c-b92c-dcd95517c8bf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:01.034169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:01.035097 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:01.035385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:01.035655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:01.037438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:01.047399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:01.048887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132deb2a-9520-4dc0-ac79-475341c6a274 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:01.057502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1203/2414] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:05.991552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:06.136764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:06.138025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:06.138456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:06.189420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031759-99b6-4f7d-9b45-f370d9b2d1a1 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:06.194828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:06.196774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:06.201371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:06.202593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:06.203211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:06.203774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] PATH_INFO: `/v3/users/235a4db21e1148268023c006778c1011` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:06.210850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235a4db21e1148268023c006778c1011)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:06.221027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:06.380198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1204/2415] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:37:06.418111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:06.420436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:06.499500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235a4db21e1148268023c006778c1011'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:06.532288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235a4db21e1148268023c006778c1011'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:06.578167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235a4db21e1148268023c006778c1011'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:06.578673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3702-23f4-4f3b-9426-067d80ebb7d9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:06.581493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235a4db21e1148268023c006778c1011'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:06.586464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:06.594469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:06.594469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:06.594469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:06.594469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:06.609793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:06.611676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1debfad-ef14-42b7-9a9b-10a6aea7833d service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:06.625911 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1205/2416] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:37:06.701068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235a4db21e1148268023c006778c1011'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:06.709179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1212/2417] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:37:05 2022] DELETE /identity/v3/users/235a4db21e1148268023c006778c1011 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:06.714873 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:06.715706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:06.716486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:06.750066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:06.759974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:06.897804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1206/2418] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:06.913907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:06.915733 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:07.026232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04048c-ab70-42dd-9e90-1e65866d7bd3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:07.032927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:07.033931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:07.036718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:07.037266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:07.060671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:07.066281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:07.089962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1213/2419] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:07.942120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:07.946896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:07.965069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41768b-a09c-4810-8c0a-05ca79d7e0a4 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:07.982001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:07.983495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:07.984217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:07.986363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] PATH_INFO: `/v3/projects/52d5938012604cd1a60026173b17a58b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:07.988761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d5938012604cd1a60026173b17a58b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:07.992474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:08.165029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d5938012604cd1a60026173b17a58b', 'request_id': 'req-03b974ff-1bf4-497a-879f-1b3d493b9bf9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.174943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d5938012604cd1a60026173b17a58b', 'request_id': 'req-03b974ff-1bf4-497a-879f-1b3d493b9bf9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.262975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d5938012604cd1a60026173b17a58b', 'request_id': 'req-03b974ff-1bf4-497a-879f-1b3d493b9bf9'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.284279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] The token cache is being invalidate because project 52d5938012604cd1a60026173b17a58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:37:08.289784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.289784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-03b974ff-1bf4-497a-879f-1b3d493b9bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.297850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1207/2420] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:37:07 2022] DELETE /identity/v3/projects/52d5938012604cd1a60026173b17a58b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:08.302126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:08.327698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc3fb-2b41-42cf-abd8-867752a00e2f service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:08.442055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:08.443125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:08.443515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:08.443789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] PATH_INFO: `/v3/users/951c475489c14fea94390e43c697d63b` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:08.445166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=951c475489c14fea94390e43c697d63b)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:08.447386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:08.657286 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951c475489c14fea94390e43c697d63b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.682579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951c475489c14fea94390e43c697d63b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.736165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951c475489c14fea94390e43c697d63b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.741560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951c475489c14fea94390e43c697d63b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.827233 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951c475489c14fea94390e43c697d63b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:08.839097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1214/2421] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:37:08 2022] DELETE /identity/v3/users/951c475489c14fea94390e43c697d63b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:08.987984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:08.988529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:08.988529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:09.046381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] MFA Rules not processed for user `442132987dad4db6a4cec799598c0ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:09.049533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:09.236119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:09.237311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1208/2422] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:09.238108 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:09.429808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e61fa9-00e6-48ec-be15-722a265277ed admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:09.442600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:09.443267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:09.443545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:09.443818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:09.445636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:09.518566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:09.520858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:09.553796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:09.555831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:09.587172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1215/2423] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:09.668882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5bf4-73c4-4091-8811-6d1bede6dd53 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:09.682963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:09.684394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:09.685782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:09.685782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] PATH_INFO: `/v3/projects/26f0780f2c2344278f05da3ae394f41b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:09.686308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f0780f2c2344278f05da3ae394f41b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:09.688328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:09.880085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f0780f2c2344278f05da3ae394f41b', 'request_id': 'req-1d43ae7f-e8ce-4e59-802f-db33a148d329'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:09.892697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f0780f2c2344278f05da3ae394f41b', 'request_id': 'req-1d43ae7f-e8ce-4e59-802f-db33a148d329'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:09.982691 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f0780f2c2344278f05da3ae394f41b', 'request_id': 'req-1d43ae7f-e8ce-4e59-802f-db33a148d329'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:09.996973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] The token cache is being invalidate because project 26f0780f2c2344278f05da3ae394f41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:37:09.997625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.035665 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.039684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1209/2424] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:37:09 2022] DELETE /identity/v3/projects/26f0780f2c2344278f05da3ae394f41b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:10.043670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:10.060341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3d74-d798-46d2-95d4-5c52a7f9e91d service nova] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:10.166122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:10.167299 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:10.167504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:10.167786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] PATH_INFO: `/v3/users/e74118bbec314c6bafb5ec7d149e6c63` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:10.169240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74118bbec314c6bafb5ec7d149e6c63)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:10.171398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:10.407223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74118bbec314c6bafb5ec7d149e6c63'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.429903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74118bbec314c6bafb5ec7d149e6c63'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.475300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74118bbec314c6bafb5ec7d149e6c63'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.479181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74118bbec314c6bafb5ec7d149e6c63'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.569146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-77e432ea-8248-4aa3-a827-a004d825de93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74118bbec314c6bafb5ec7d149e6c63'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:10.576361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1216/2425] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:37:10 2022] DELETE /identity/v3/users/e74118bbec314c6bafb5ec7d149e6c63 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:11.489138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:11.489138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:11.518046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ae7f-e8ce-4e59-802f-db33a148d329 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:11.652446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:11.652787 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:11.653101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:11.653468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] PATH_INFO: `/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:11.654810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4232008d9d4e5992de1e6a6211ea5f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:11.656837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.004526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4232008d9d4e5992de1e6a6211ea5f', 'request_id': 'req-c254862e-5ecb-4cda-a255-b6b593654b9f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:12.011644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4232008d9d4e5992de1e6a6211ea5f', 'request_id': 'req-c254862e-5ecb-4cda-a255-b6b593654b9f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:12.128924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4232008d9d4e5992de1e6a6211ea5f', 'request_id': 'req-c254862e-5ecb-4cda-a255-b6b593654b9f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:12.149461 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] The token cache is being invalidate because project cc4232008d9d4e5992de1e6a6211ea5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:37:12.151201 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:12.153918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c254862e-5ecb-4cda-a255-b6b593654b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:12.156482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1210/2426] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:37:11 2022] DELETE /identity/v3/projects/cc4232008d9d4e5992de1e6a6211ea5f => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:12.160954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.161967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.162483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.183519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:12.184896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:12.281763 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1217/2427] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:12.299315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.299584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.300032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.334277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:12.336956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:12.356470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1211/2428] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:12.360444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.371469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215d40-5330-49d2-8b06-f0702c118eb5 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.376360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.377898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.378342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.380904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.380904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:37:12.380904 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.382843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.407888 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1218/2429] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:37:12.408863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.419655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c2ca9-6a7d-4148-bd0f-111e07506ed5 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.426615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.427295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.427575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.427842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.428522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.430741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.538811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1212/2430] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:37:12 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:37:12.542900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.559846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d944-eb40-4c55-89b3-87d13bfe3294 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.643002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.643683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.643963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.644240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.644936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.646918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.759928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1219/2431] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:37:12 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:37:12.764879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.778522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7ae49-1ddb-4879-883e-2a81efa143ac admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.788747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.789776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.790243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.790673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.791555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.793635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.805937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1213/2432] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:37:12.813844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.835167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09213c-aff0-4f53-b22f-871c79af13bd admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.844218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.844892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.845173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.845481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.846487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.848274 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be5ca-cbc7-4c3d-b311-8383c7b23172 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:12.863734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1220/2433] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:37:12.867717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:12.880111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036b2ff-2c2a-48ce-b5f8-9b74cbd0a821 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:12.885175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:12.886267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:12.886551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:12.887543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] PATH_INFO: `/v3/projects/8c145ebf662a44dba276dde5bb33a5f9/users/6b6e9bb441c145e9a2d1d408d27c7dbd/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:12.906087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c145ebf662a44dba276dde5bb33a5f9, user_id=6b6e9bb441c145e9a2d1d408d27c7dbd, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:12.909565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:13.032947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1214/2434] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:37:12 2022] PUT /identity/v3/projects/8c145ebf662a44dba276dde5bb33a5f9/users/6b6e9bb441c145e9a2d1d408d27c7dbd/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:13.038275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb6e9-b4ec-44d4-aeae-1aaaf5a640bf None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:13.038764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb6e9-b4ec-44d4-aeae-1aaaf5a640bf None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:13.039226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb6e9-b4ec-44d4-aeae-1aaaf5a640bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:13.063611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ff8bb6e9-b4ec-44d4-aeae-1aaaf5a640bf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:13.066450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ff8bb6e9-b4ec-44d4-aeae-1aaaf5a640bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:13.153206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1221/2435] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:13.164445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:13.166772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:13.265313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203eb05-0d1e-4905-9239-e25e058324db admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:13.267848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:13.269352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:13.269862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:13.270320 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:13.283202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:13.284655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:13.298999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1215/2436] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:15.312552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ef8-bee0-4625-b9b5-5f15594941b5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:15.313050 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ef8-bee0-4625-b9b5-5f15594941b5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:15.313135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680ef8-bee0-4625-b9b5-5f15594941b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:15.348992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9b680ef8-bee0-4625-b9b5-5f15594941b5 None None] MFA Rules not processed for user `6b6e9bb441c145e9a2d1d408d27c7dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:15.350242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9b680ef8-bee0-4625-b9b5-5f15594941b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:15.429094 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1222/2437] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:15.440998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:15.443232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:15.530596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cbe68-a6cc-440e-b32a-457808f374e9 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:15.536101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:15.536760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:15.537041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:15.537313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:15.560155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:15.561580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2fe7-1819-473c-82fd-6a14ce3de138 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:15.586863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1216/2438] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:17.904076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a596-9a3f-420b-81d7-40f0f299c490 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:17.904983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a596-9a3f-420b-81d7-40f0f299c490 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:17.905290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a596-9a3f-420b-81d7-40f0f299c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:17.925885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4f67a596-9a3f-420b-81d7-40f0f299c490 None None] MFA Rules not processed for user `6b6e9bb441c145e9a2d1d408d27c7dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:17.927535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4f67a596-9a3f-420b-81d7-40f0f299c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:17.935195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1223/2439] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:32.162152 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:32.163157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:32.163640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:32.185160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f4d8-1a70-4b1a-bdc0-9da28bf77eaa None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:32.185578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f4d8-1a70-4b1a-bdc0-9da28bf77eaa None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:32.185796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f4d8-1a70-4b1a-bdc0-9da28bf77eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:32.197767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:32.197767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:32.210940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-6835f4d8-1a70-4b1a-bdc0-9da28bf77eaa None None] MFA Rules not processed for user `384b83917c9a4766b0117de6e71942ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:32.212165 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6835f4d8-1a70-4b1a-bdc0-9da28bf77eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:32.268881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1217/2440] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:32.284639 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:32.287877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:32.319341 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1224/2441] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:32.395781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa7ca-e571-4d93-ac34-49538b79eac9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:32.401575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:32.402439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:32.402792 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:32.403053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:32.424363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:32.426486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:32.439018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1218/2442] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:37:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 25 03:37:47.984767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7dff-43aa-4595-8b3e-387c5d84bcf5 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:47.985270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7dff-43aa-4595-8b3e-387c5d84bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:47.985366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7dff-43aa-4595-8b3e-387c5d84bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:48.004385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-2a7b7dff-43aa-4595-8b3e-387c5d84bcf5 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:48.005576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-2a7b7dff-43aa-4595-8b3e-387c5d84bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:48.014087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1225/2443] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:37:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:48.035039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:48.045250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30873a-a9e3-4dfc-b3ae-e7c64458a0c1 service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:48.050151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:48.050772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:48.051052 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:48.051324 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:48.059726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:48.061293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:48.069058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1219/2444] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:37:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:37:48.611616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:48.612066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:48.614198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:48.635157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] MFA Rules not processed for user `6b6e9bb441c145e9a2d1d408d27c7dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:48.636342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:48.643213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1226/2445] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:50.239819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:50.249092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5478b-346a-4b3d-adda-e4271d6fd95f service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:50.252748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:50.253375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:50.253685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:50.254017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:50.255794 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:50.267575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:50.271454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:50.279120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1220/2446] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:55.127314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:55.135687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:55.144302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166794-faed-48ef-84f9-1af9e513bfd1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:55.148846 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:55.149853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:55.150171 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:55.150545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] PATH_INFO: `/v3/users/556f14d079254d7e91fc1e942e2a30a4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:55.151818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=556f14d079254d7e91fc1e942e2a30a4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:55.154511 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:55.353206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556f14d079254d7e91fc1e942e2a30a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.360017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556f14d079254d7e91fc1e942e2a30a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.372001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556f14d079254d7e91fc1e942e2a30a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.372655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556f14d079254d7e91fc1e942e2a30a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.425716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-33636f11-6fb2-49d1-995d-5c69793a4f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556f14d079254d7e91fc1e942e2a30a4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.431911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1227/2447] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:37:55 2022] DELETE /identity/v3/users/556f14d079254d7e91fc1e942e2a30a4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:55.678615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:55.692447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b487a0-96bc-41f9-9567-0c5a0d836641 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:55.746708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:55.747563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:55.747896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:55.748240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] PATH_INFO: `/v3/projects/eb7222adc16e4fffa44214043ad0c7ad` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:55.749416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7222adc16e4fffa44214043ad0c7ad)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:55.751383 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:55.882572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7222adc16e4fffa44214043ad0c7ad', 'request_id': 'req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.888510 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7222adc16e4fffa44214043ad0c7ad', 'request_id': 'req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:55.997734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7222adc16e4fffa44214043ad0c7ad', 'request_id': 'req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:56.008941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] The token cache is being invalidate because project eb7222adc16e4fffa44214043ad0c7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:37:56.009223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:56.009861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8a60666f-7d8b-4bfb-9617-5b7a8c5cc887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:37:56.014632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1221/2448] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:37:55 2022] DELETE /identity/v3/projects/eb7222adc16e4fffa44214043ad0c7ad => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:56.016883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.017229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.017516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.034738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:56.036026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:56.094591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1228/2449] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:56.102797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.103081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.103347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.121179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:56.122938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:56.133309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1222/2450] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:56.141088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.148219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bdc2-5c06-4ea2-888d-51072f56e13a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.152772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.153414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.153722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.153997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.154703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:37:56.155298 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.156600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.168029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1229/2451] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:37:56.172205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.181833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1fbfd-8424-494d-990f-0b8f2b4203dc None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.186333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.187141 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.187491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.187828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.188680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.190689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.295834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1223/2452] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:37:56 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:37:56.299667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.310746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba6e-c21f-4d4d-9916-221ea7293821 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.369214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.369917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.370196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.370467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.371179 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.373765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.465909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1230/2453] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:37:56 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:37:56.470380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.481207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04ed26-4e3f-4659-b796-7d6525100ae3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.486361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.487136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.487474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.487818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.488603 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.490394 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.504809 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1224/2454] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:37:56.517721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.531962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1b15-3961-4926-83cb-271922eac039 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.537190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.538204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.538636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.539073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.540110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.541913 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346cc69-d75e-4406-9f95-d532dfd46960 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.553594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1231/2455] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:37:56.558045 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.568293 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c50cf-638a-4cff-bab9-6e14027b4ff9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.577252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.578192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.578469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.578897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] PATH_INFO: `/v3/projects/3657188275fc4fd8850326597a061ebd/users/95e0ebb3365d4b4dbbe3993f6388cbcf/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.594569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3657188275fc4fd8850326597a061ebd, user_id=95e0ebb3365d4b4dbbe3993f6388cbcf, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.597361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.700842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1225/2456] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:37:56 2022] PUT /identity/v3/projects/3657188275fc4fd8850326597a061ebd/users/95e0ebb3365d4b4dbbe3993f6388cbcf/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:56.705867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834bcb-96fc-4a32-bc96-b671fdfb5c97 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.706163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834bcb-96fc-4a32-bc96-b671fdfb5c97 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.706466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834bcb-96fc-4a32-bc96-b671fdfb5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.724680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-72834bcb-96fc-4a32-bc96-b671fdfb5c97 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:56.725852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-72834bcb-96fc-4a32-bc96-b671fdfb5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:56.783009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1232/2457] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:56.792423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:56.794760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:56.849305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f63d2-de5d-4773-8110-31df9468e1da admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:56.852941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:56.853563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:56.853871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:56.854142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:56.863796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:56.865221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:56.875037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1226/2458] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:37:58.181047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.181622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.181622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.214755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] MFA Rules not processed for user `95e0ebb3365d4b4dbbe3993f6388cbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:37:58.216062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:58.294210 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1233/2459] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:37:58.298740 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:58.308342 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eb0d6-360b-4893-9c90-8d8c16535759 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:58.313396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:58.314090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.314373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.314666 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.315341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:58.317364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:58.405208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1227/2460] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:37:58 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:37:58.409230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:58.420401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7c43-2805-4dda-b50d-dec69c81e56a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:58.474183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:58.474840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.475118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.475391 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.476076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:58.478058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:58.626235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1234/2461] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:37:58 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:37:58.630173 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:58.640291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bcfd-2ded-4d24-b82b-fb689d733767 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:58.644777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:58.645419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.645738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.646015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.646720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:58.648312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:58.659238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1228/2462] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:37:58.663116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:58.673536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c6b-3148-49ba-bac6-373be6fff275 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:58.678170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:58.679037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.679314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.679583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] PATH_INFO: `/v3/projects/36f199050c574d1da0c6f549f290aa7a/users/4923fb44aeec480794570caa15128d1b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.824571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f199050c574d1da0c6f549f290aa7a, user_id=4923fb44aeec480794570caa15128d1b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:58.827310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:58.907328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1235/2463] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:37:58 2022] PUT /identity/v3/projects/36f199050c574d1da0c6f549f290aa7a/users/4923fb44aeec480794570caa15128d1b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:37:58.911081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:58.921321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fb66c-2672-4d18-aa07-bbf706a2095b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:58.977459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:58.978288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:58.978592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:58.978865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:58.979582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:58.981191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:58.992818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1229/2464] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:37:58.995673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:59.005932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd96-0eb6-4b9b-ad01-c4bfe24c414d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:59.010440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:59.011301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:59.011578 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:59.011847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] PATH_INFO: `/v3/projects/36f199050c574d1da0c6f549f290aa7a/users/4923fb44aeec480794570caa15128d1b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:59.014331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f199050c574d1da0c6f549f290aa7a, user_id=4923fb44aeec480794570caa15128d1b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:59.016964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248aa26-94e7-4003-a32c-09be5ab5b363 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:59.026979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1236/2465] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:37:58 2022] PUT /identity/v3/projects/36f199050c574d1da0c6f549f290aa7a/users/4923fb44aeec480794570caa15128d1b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:37:59.666131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:37:59.723956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512073a3-df33-4b1a-8036-812b8645fd0f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:37:59.771276 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:37:59.771909 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:37:59.772187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:37:59.772458 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:37:59.774217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:37:59.835243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:37:59.836683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:37:59.846611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1230/2466] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:37:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:00.443231 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:00.443683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:00.443809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:00.492324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] MFA Rules not processed for user `4923fb44aeec480794570caa15128d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:00.494517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:00.590257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1237/2467] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:02.044863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:02.111561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f9dd-f372-49d0-814a-ca86b0e70327 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:02.116168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:02.117023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:02.117301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:02.117571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] PATH_INFO: `/v3/users/95e0ebb3365d4b4dbbe3993f6388cbcf` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:02.118768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e0ebb3365d4b4dbbe3993f6388cbcf)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:02.120704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:02.302274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e0ebb3365d4b4dbbe3993f6388cbcf'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.308890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e0ebb3365d4b4dbbe3993f6388cbcf'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.383986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e0ebb3365d4b4dbbe3993f6388cbcf'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.396092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e0ebb3365d4b4dbbe3993f6388cbcf'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.396730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e0ebb3365d4b4dbbe3993f6388cbcf'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.404138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1231/2468] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:02 2022] DELETE /identity/v3/users/95e0ebb3365d4b4dbbe3993f6388cbcf => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:02.703273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:02.717466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6969-d62e-4c79-a1ab-2e320c650700 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:02.785463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:02.786704 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:02.787205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:02.787648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] PATH_INFO: `/v3/projects/3657188275fc4fd8850326597a061ebd` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:02.789178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3657188275fc4fd8850326597a061ebd)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:02.791485 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:02.946881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3657188275fc4fd8850326597a061ebd', 'request_id': 'req-d71e707b-4e16-40ed-ae39-4e8cacf04111'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.953495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3657188275fc4fd8850326597a061ebd', 'request_id': 'req-d71e707b-4e16-40ed-ae39-4e8cacf04111'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:02.967653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3657188275fc4fd8850326597a061ebd', 'request_id': 'req-d71e707b-4e16-40ed-ae39-4e8cacf04111'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.048044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] The token cache is being invalidate because project 3657188275fc4fd8850326597a061ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:03.048519 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.049295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.051066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1238/2469] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:02 2022] DELETE /identity/v3/projects/3657188275fc4fd8850326597a061ebd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:03.054914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:03.056533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:03.069826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e12795-ccf8-4acb-adf1-f8f484cdca28 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:03.129432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:03.130599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:03.131087 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:03.131507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] PATH_INFO: `/v3/users/4923fb44aeec480794570caa15128d1b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:03.132901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4923fb44aeec480794570caa15128d1b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:03.135321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:03.331029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4923fb44aeec480794570caa15128d1b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.337532 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4923fb44aeec480794570caa15128d1b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.447703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4923fb44aeec480794570caa15128d1b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.448116 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:03.449807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:03.463373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4923fb44aeec480794570caa15128d1b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.464252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4923fb44aeec480794570caa15128d1b'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.471547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1232/2470] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:03 2022] DELETE /identity/v3/users/4923fb44aeec480794570caa15128d1b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:03.537115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e707b-4e16-40ed-ae39-4e8cacf04111 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:03.605655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:03.606357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:03.607193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:03.607470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:03.609405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:03.672073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:03.673876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f2e41-e644-452a-aa6e-9f4e79a94aaa service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:03.683741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1239/2471] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:03.724731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:03.726262 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:03.805739 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e80e89-d8ba-4016-990a-9a5693d3dd21 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:03.811028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:03.811867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:03.812146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:03.812471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] PATH_INFO: `/v3/projects/36f199050c574d1da0c6f549f290aa7a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:03.813920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f199050c574d1da0c6f549f290aa7a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:03.816155 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:03.943812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f199050c574d1da0c6f549f290aa7a', 'request_id': 'req-2d8ad576-4578-4981-b220-682be179b0f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:03.949024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f199050c574d1da0c6f549f290aa7a', 'request_id': 'req-2d8ad576-4578-4981-b220-682be179b0f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:04.031165 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f199050c574d1da0c6f549f290aa7a', 'request_id': 'req-2d8ad576-4578-4981-b220-682be179b0f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:04.047591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] The token cache is being invalidate because project 36f199050c574d1da0c6f549f290aa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:04.047591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:04.047591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2d8ad576-4578-4981-b220-682be179b0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:04.047591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1233/2472] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:03 2022] DELETE /identity/v3/projects/36f199050c574d1da0c6f549f290aa7a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:04.049891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.050354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.050450 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.069595 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:04.070868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:04.129546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1240/2473] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:04.137257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.145553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.145553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.156750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:04.157975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:04.166376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1234/2474] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:04.170458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.180073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318000-0fe5-47d9-96cb-cf11da2ab5d9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.184640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.185872 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.186149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.186416 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.187121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:04.187426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.189022 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.200266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1241/2475] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:04.217275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.226801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0f18-1735-47f9-9228-672e78d49544 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.231489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.236419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.236419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.236419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.236419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.236419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.331650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1235/2476] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:04.337062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.347144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c41c-d9ea-4a0e-92d7-fa3d2422c67e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.408459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.408459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.408459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.408459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.408907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.408907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.506591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1242/2477] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:04.514015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.524120 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3368848-5e8e-45ea-9f81-07d30e2fae0a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.529723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.533707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.533707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.533707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.533707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.533707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.544286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1236/2478] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:04.548896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.559348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522ebd-1a52-4886-838e-e474c4dd22e1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.564636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.568073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.568073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.568073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.568073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.568475 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee153e-3334-457c-a4e6-ad51a1abf43e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.578157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1243/2479] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:04.582343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.593211 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165ea3-ba88-4381-acf0-ebe010bb51df admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.598220 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.599089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.599368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.599636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] PATH_INFO: `/v3/projects/3e0ed91db9274fc2aa1d59fdd96923c4/users/f94a3de7e30b426cb82c6df09695de1f/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.614445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0ed91db9274fc2aa1d59fdd96923c4, user_id=f94a3de7e30b426cb82c6df09695de1f, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.617136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.677169 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1237/2480] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:04 2022] PUT /identity/v3/projects/3e0ed91db9274fc2aa1d59fdd96923c4/users/f94a3de7e30b426cb82c6df09695de1f/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:04.687534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.688150 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.688441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.715335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] MFA Rules not processed for user `f94a3de7e30b426cb82c6df09695de1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:04.716789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:04.778640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1244/2481] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:04.784611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.847412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1870f22-018b-4ec5-9a84-f06eeff32d70 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:04.852110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:04.852888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:04.853083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:04.853358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:04.854082 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:04.856003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:04.958813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1238/2482] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:04.962900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:04.974458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0e4a-f63f-4dfa-ba8b-15a9cbdbd5da None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.028718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.029380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.029801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.030701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.031399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.033329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.134699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1245/2483] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:04 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:05.138844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.149685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bed62-b0bd-4972-8a1d-e0ef3491c306 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.154248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.154920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.155811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.156109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.156804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.158451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.169090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1239/2484] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:05.175606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.185720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611fdb-e031-4502-b726-8c59149c35e1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.190452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.191338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.191617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.191882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] PATH_INFO: `/v3/projects/4208b325a7de4201b9b9ed6e5557119b/users/ba0d0fafe53b4d4c8b2f092063fa6779/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.208028 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4208b325a7de4201b9b9ed6e5557119b, user_id=ba0d0fafe53b4d4c8b2f092063fa6779, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.210771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.322873 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1246/2485] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:05 2022] PUT /identity/v3/projects/4208b325a7de4201b9b9ed6e5557119b/users/ba0d0fafe53b4d4c8b2f092063fa6779/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:05.327622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.337195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad27d-a55e-4717-a3a3-9282e85c03e2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.394035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.394694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.394973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.395245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.395956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.397536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606c75b-2d8a-4c07-852d-fad67fd47721 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.407182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1240/2486] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:05.411397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.421425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d4072-faba-4061-b5c5-994498f6aaa0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.426187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.427059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.427335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.427602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] PATH_INFO: `/v3/projects/4208b325a7de4201b9b9ed6e5557119b/users/ba0d0fafe53b4d4c8b2f092063fa6779/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.429560 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4208b325a7de4201b9b9ed6e5557119b, user_id=ba0d0fafe53b4d4c8b2f092063fa6779, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.432242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.443937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1247/2487] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:05 2022] PUT /identity/v3/projects/4208b325a7de4201b9b9ed6e5557119b/users/ba0d0fafe53b4d4c8b2f092063fa6779/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:05.455907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.456199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.456479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.486976 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] MFA Rules not processed for user `ba0d0fafe53b4d4c8b2f092063fa6779`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:05.488187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:05.566302 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1241/2488] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:05.578317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.579972 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:05.636614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b5b2-c39c-4fe1-928f-8bc9b6962af5 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.640921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.641558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.641893 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.646115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.651481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.652923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4d6e4-b08a-426f-a24a-81fa7dbe0664 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.662694 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1248/2489] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:05.887247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:05.896902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc135a3-a450-4fc3-80ea-22b852304bbf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:05.900583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:05.901210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:05.901554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:05.901860 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:05.956810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:05.958583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:05.968660 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1242/2490] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:16.508790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:16.509301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:16.509424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:16.526829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:16.528005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:16.579826 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1249/2491] 10.222.0.24 () {58 vars in 1009 bytes} [Fri Mar 25 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:16.592233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:16.593618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:16.662500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d559d-4237-4fd4-a3be-f5b5b8c6590c service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:16.667358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:16.668064 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:16.668339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:16.668610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:16.676491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:16.678707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcca30-4b04-4da0-a451-b95087984f96 service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:16.686709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1243/2492] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:38:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 25 03:38:20.565337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:20.639372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71dda-61a6-48bd-929a-667a27208593 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:20.644354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:20.645474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:20.646506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:20.646993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] PATH_INFO: `/v3/users/f94a3de7e30b426cb82c6df09695de1f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:20.648418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94a3de7e30b426cb82c6df09695de1f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:20.650646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:20.864055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94a3de7e30b426cb82c6df09695de1f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:20.873941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94a3de7e30b426cb82c6df09695de1f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:20.890565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94a3de7e30b426cb82c6df09695de1f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:20.892688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94a3de7e30b426cb82c6df09695de1f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:20.992497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94a3de7e30b426cb82c6df09695de1f'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.000764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1250/2493] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:20 2022] DELETE /identity/v3/users/f94a3de7e30b426cb82c6df09695de1f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:21.005376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:21.005904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:21.006057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:21.036096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:21.038754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:21.105016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1244/2494] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:21.115838 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:21.117515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:21.177496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4de2e-dfe4-4460-8a35-9454174e0e15 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:21.181465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:21.182214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:21.182668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:21.183008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:21.192435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:21.194550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:21.217887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1251/2495] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:21.654730 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:21.656248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:21.672525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89896-f2f8-48a0-a711-6c58298340c0 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:21.679215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:21.680133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:21.680536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:21.680887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] PATH_INFO: `/v3/projects/3e0ed91db9274fc2aa1d59fdd96923c4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:21.683160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0ed91db9274fc2aa1d59fdd96923c4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:21.685175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:21.851020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0ed91db9274fc2aa1d59fdd96923c4', 'request_id': 'req-e395b341-9fd5-4981-8906-31a6479293f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.856979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0ed91db9274fc2aa1d59fdd96923c4', 'request_id': 'req-e395b341-9fd5-4981-8906-31a6479293f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.940016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0ed91db9274fc2aa1d59fdd96923c4', 'request_id': 'req-e395b341-9fd5-4981-8906-31a6479293f4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.952708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] The token cache is being invalidate because project 3e0ed91db9274fc2aa1d59fdd96923c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:21.953066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.953644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:21.958303 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1245/2496] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:21 2022] DELETE /identity/v3/projects/3e0ed91db9274fc2aa1d59fdd96923c4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:21.959997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:21.970469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5300a-1c8a-4247-9dc8-6ba7a21f0a15 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:22.064992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:22.066278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:22.066609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:22.066983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] PATH_INFO: `/v3/users/ba0d0fafe53b4d4c8b2f092063fa6779` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:22.069021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0d0fafe53b4d4c8b2f092063fa6779)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:22.070986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:22.205855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0d0fafe53b4d4c8b2f092063fa6779'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:22.213242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0d0fafe53b4d4c8b2f092063fa6779'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:22.226558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0d0fafe53b4d4c8b2f092063fa6779'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:22.227657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0d0fafe53b4d4c8b2f092063fa6779'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:22.320703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-de7c9185-f4a0-4cdb-8d1b-f72aafa10812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0d0fafe53b4d4c8b2f092063fa6779'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:22.330351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1252/2497] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:21 2022] DELETE /identity/v3/users/ba0d0fafe53b4d4c8b2f092063fa6779 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:23.027553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.028993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:23.045190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b341-9fd5-4981-8906-31a6479293f4 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.105288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.106187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.106482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.106756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] PATH_INFO: `/v3/projects/4208b325a7de4201b9b9ed6e5557119b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.108516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4208b325a7de4201b9b9ed6e5557119b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.110495 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.238121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4208b325a7de4201b9b9ed6e5557119b', 'request_id': 'req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:23.245962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4208b325a7de4201b9b9ed6e5557119b', 'request_id': 'req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:23.311449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4208b325a7de4201b9b9ed6e5557119b', 'request_id': 'req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:23.324664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] The token cache is being invalidate because project 4208b325a7de4201b9b9ed6e5557119b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:23.325089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:23.325857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-11a75dcd-7ec9-4a92-acf1-7eac1c725eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:23.327733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1246/2498] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:23 2022] DELETE /identity/v3/projects/4208b325a7de4201b9b9ed6e5557119b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:23.335095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.335770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.335770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.357296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:23.358678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:23.421653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1253/2499] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:23.430005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.430333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.430712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.455018 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:23.457138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:23.472184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1247/2500] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:23.473599 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.486627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae753-e913-4282-9e83-ebbd9f49121d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.492447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.493052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.493313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.493582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.494326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:23.495962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.496477 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.513201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1254/2501] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:23.518322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.530423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ed05-10ea-40d7-aea6-fbb8bb433814 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.536059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.537059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.537454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.537758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.538618 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.541272 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.628681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1248/2502] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:23 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:23.634163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.644844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834831c8-b112-4cf5-98de-015d4c456650 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.713755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.715321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.715321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.715854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.716855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.718869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.812387 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1255/2503] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:23 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:23.816721 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.829474 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1168a51-ed68-468c-af41-ff44e30f62b6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.834810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.835475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.835758 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.836056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.836877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.838537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.855190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1249/2504] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:23.859118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.870375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017af68-19ed-429d-ba54-79b662505b64 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.875389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.876137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.876502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.876849 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.877905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.879702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edd849-17dc-42c4-a273-fb2dbc5bf54a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:23.891007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1256/2505] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:23.894989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:23.905925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454fb87-dc91-4883-91a8-dc27dd554e10 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:23.912462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:23.913346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:23.913624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:23.913944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] PATH_INFO: `/v3/projects/5fbb1e4faf264697b1c4b2ec8de6d877/users/48609e9d77ce4d4090cd55a9bb205238/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:23.930952 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbb1e4faf264697b1c4b2ec8de6d877, user_id=48609e9d77ce4d4090cd55a9bb205238, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:23.933866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.018725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1250/2506] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:23 2022] PUT /identity/v3/projects/5fbb1e4faf264697b1c4b2ec8de6d877/users/48609e9d77ce4d4090cd55a9bb205238/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:24.028965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.029481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.029929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.065986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] MFA Rules not processed for user `48609e9d77ce4d4090cd55a9bb205238`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:24.067522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:24.168664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1257/2507] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:24.173762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.240356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f5584-01d0-4812-8e73-d3870427d406 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.245501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.246227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.246511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.246796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.247475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.249445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.369406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1251/2508] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:24 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:24.374491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.385977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd3f2-e549-4c5b-8d14-9c5d11bbe094 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.450098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.450833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.451119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.451396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.452093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.454173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.538568 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1258/2509] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:24 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:24.539790 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.553636 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f4725-862b-47f3-9565-e37cb83c8736 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.558894 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.559647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.560109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.563481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.563481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.563481 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.577939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1252/2510] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:24.579801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.591046 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339aeb-6f3c-404b-bd26-01c6d4860924 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.596159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.597076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.597357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.597636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] PATH_INFO: `/v3/projects/68793125f6ad48a3b15073e24398677f/users/bc22b9dc8fb54faa83b276a83838c411/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.613801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68793125f6ad48a3b15073e24398677f, user_id=bc22b9dc8fb54faa83b276a83838c411, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.616556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.680357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1259/2511] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:24 2022] PUT /identity/v3/projects/68793125f6ad48a3b15073e24398677f/users/bc22b9dc8fb54faa83b276a83838c411/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:24.684282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.695517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea8cc-5524-4f02-a83b-731a160420da admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.765491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.766512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.766969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.767399 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.768149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.769846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70ecb-7961-4081-bffa-9c09d2df70a8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.781108 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1253/2512] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:24.785325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.796213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4b77-dcf6-4847-9a6c-4e56fda0bdd1 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:24.801254 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:24.802258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.802545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.802928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] PATH_INFO: `/v3/projects/68793125f6ad48a3b15073e24398677f/users/bc22b9dc8fb54faa83b276a83838c411/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.806356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68793125f6ad48a3b15073e24398677f, user_id=bc22b9dc8fb54faa83b276a83838c411, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:24.809214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:24.835195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:24.835542 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:24.835813 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:24.837546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1260/2513] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:24 2022] PUT /identity/v3/projects/68793125f6ad48a3b15073e24398677f/users/bc22b9dc8fb54faa83b276a83838c411/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:24.864343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] MFA Rules not processed for user `bc22b9dc8fb54faa83b276a83838c411`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:24.865775 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:24.949867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1254/2514] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:24.962375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:24.964938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:25.032834 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c75b43-4149-4f78-bfde-f67a7b1fffe3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:25.036802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:25.037449 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:25.037767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:25.038042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:25.050709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:25.052829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:25.063017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1261/2515] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:25.313544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:25.315501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:25.333231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9f2d-ece3-4251-b4be-dca74e84094a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:25.338274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:25.339322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:25.339696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:25.340046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:25.412389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:25.414387 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b08bc8-da10-42ce-b764-0372cc2a377d service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:25.424492 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1255/2516] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:29.696986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:29.762627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ad7f-f4dc-44aa-b19f-7435848c5d1a service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:29.767655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:29.768659 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:29.769058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:29.769428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] PATH_INFO: `/v3/users/48609e9d77ce4d4090cd55a9bb205238` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:29.770770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48609e9d77ce4d4090cd55a9bb205238)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:29.772883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:30.071727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48609e9d77ce4d4090cd55a9bb205238'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:30.079181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48609e9d77ce4d4090cd55a9bb205238'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:30.092068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48609e9d77ce4d4090cd55a9bb205238'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:30.092914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48609e9d77ce4d4090cd55a9bb205238'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:30.237018 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48609e9d77ce4d4090cd55a9bb205238'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:30.244988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1262/2517] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:29 2022] DELETE /identity/v3/users/48609e9d77ce4d4090cd55a9bb205238 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:30.249904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:30.250412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:30.250506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:30.269212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:30.270448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:30.332264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1256/2518] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:30.342916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:30.344340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:30.406493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942449-1509-44d8-9db6-3f11d983729c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:30.412104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:30.413158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:30.413584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:30.413894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:30.424548 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:30.426026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:30.436246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1263/2519] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:30.897316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:30.900796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:30.922906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e63e45-4c10-47a1-ba3d-46a4339f959d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:30.929496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:30.931291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:30.932657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:30.933123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] PATH_INFO: `/v3/projects/5fbb1e4faf264697b1c4b2ec8de6d877` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:30.934898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbb1e4faf264697b1c4b2ec8de6d877)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:30.937307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:31.085529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbb1e4faf264697b1c4b2ec8de6d877', 'request_id': 'req-14f44a34-888a-4859-a723-84509c0ecf5a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.092192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbb1e4faf264697b1c4b2ec8de6d877', 'request_id': 'req-14f44a34-888a-4859-a723-84509c0ecf5a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.185455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbb1e4faf264697b1c4b2ec8de6d877', 'request_id': 'req-14f44a34-888a-4859-a723-84509c0ecf5a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.199029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] The token cache is being invalidate because project 5fbb1e4faf264697b1c4b2ec8de6d877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:31.199768 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.200457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.204935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1257/2520] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:30 2022] DELETE /identity/v3/projects/5fbb1e4faf264697b1c4b2ec8de6d877 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:31.206368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:31.218592 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0a61-ba46-4460-89db-e0d6b74f859d service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:31.282081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:31.283426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:31.284003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:31.284530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] PATH_INFO: `/v3/users/bc22b9dc8fb54faa83b276a83838c411` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:31.285981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc22b9dc8fb54faa83b276a83838c411)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:31.288288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:31.486369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc22b9dc8fb54faa83b276a83838c411'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.497127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc22b9dc8fb54faa83b276a83838c411'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.512376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc22b9dc8fb54faa83b276a83838c411'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.513634 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc22b9dc8fb54faa83b276a83838c411'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.574311 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f00e0b22-9ca9-4706-8366-bd86bd442a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc22b9dc8fb54faa83b276a83838c411'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:31.584898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1264/2521] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:31 2022] DELETE /identity/v3/users/bc22b9dc8fb54faa83b276a83838c411 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:32.119671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:32.121736 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:32.137617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44a34-888a-4859-a723-84509c0ecf5a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:32.205334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:32.206314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.206670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.209742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] PATH_INFO: `/v3/projects/68793125f6ad48a3b15073e24398677f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.211230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68793125f6ad48a3b15073e24398677f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:32.214695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:32.375747 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68793125f6ad48a3b15073e24398677f', 'request_id': 'req-14ed5e35-412a-42f8-9eb5-e96c258f4497'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:32.382343 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68793125f6ad48a3b15073e24398677f', 'request_id': 'req-14ed5e35-412a-42f8-9eb5-e96c258f4497'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:32.446261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68793125f6ad48a3b15073e24398677f', 'request_id': 'req-14ed5e35-412a-42f8-9eb5-e96c258f4497'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:32.463005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] The token cache is being invalidate because project 68793125f6ad48a3b15073e24398677f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:32.463634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:32.464822 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-14ed5e35-412a-42f8-9eb5-e96c258f4497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:32.468650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1258/2522] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:32 2022] DELETE /identity/v3/projects/68793125f6ad48a3b15073e24398677f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:32.476043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.477005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.477442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.501242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:32.502859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:32.589372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1265/2523] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:32.598791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.598791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.598791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.620381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:32.621819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:32.633697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1259/2524] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:32.635508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:32.647773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f03ba-883c-4b0a-b4a5-56c221e1603a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:32.652537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:32.653276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.653641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.654031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.654823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:32.655199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:32.658085 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:32.674399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1266/2525] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:32.675370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:32.688966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076c49e-af3e-4735-be9f-97c4edbb3c34 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:32.695651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:32.696641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.697075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.697407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.698154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:32.700297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:32.837032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1260/2526] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:32 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:32.841095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:32.854724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482a87-bbf1-401f-9004-526123995905 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:32.931601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:32.932531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:32.932817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:32.933089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:32.933945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:32.936433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.132011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1267/2527] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:32 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:33.136195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.146676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522348b-8b31-4578-81e6-38dc33aeaad7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.151318 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.151966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.152244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.152515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.153261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.154875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.165683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1261/2528] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:33.169952 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.180964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5756f4-bde3-4096-83cd-c560d268d2d9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.185654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.186342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.186624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.186896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.187607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.189244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bd89b-7848-41c1-91e7-1e3219b525f9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.200004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1268/2529] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:33.210788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.228641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d976f5-0cc8-4495-81b7-2b72287f861d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.233605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.234521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.234832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.235104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] PATH_INFO: `/v3/projects/a7a7cf92136946d487a125855c9def67/users/4a583f84950f4a75ae7f2868fc8f2343/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.250506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7cf92136946d487a125855c9def67, user_id=4a583f84950f4a75ae7f2868fc8f2343, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.253158 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.379663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1262/2530] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:33 2022] PUT /identity/v3/projects/a7a7cf92136946d487a125855c9def67/users/4a583f84950f4a75ae7f2868fc8f2343/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:33.396951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.396951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.396951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.418370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] MFA Rules not processed for user `4a583f84950f4a75ae7f2868fc8f2343`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:33.419562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:33.480334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1269/2531] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:33.484935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.547380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aba10-7794-4f80-a665-0668a170d962 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.552006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.552651 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.553019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.553290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.554098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.556053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.643345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1263/2532] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:33 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:33.648102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.658816 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5e7cd-f7b9-4a51-bcd1-90e70ebd1d41 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.714550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.714802 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.715109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.715377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.716065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.718307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.842936 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1270/2533] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:33 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:33.847208 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.857095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e71a-cba9-43bc-8ea8-1838f50cccac admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.861800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.862439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.862715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.863025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.863734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.865390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.876756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1264/2534] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:33.881305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.891068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ed16-13be-4a84-8ec1-25db43d97892 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:33.896219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:33.897089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:33.897361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:33.897620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] PATH_INFO: `/v3/projects/2df605cb28f54ec4a3133374d5b70fce/users/7fb11375c5c542b58cb9a579f59327b4/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:33.912099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df605cb28f54ec4a3133374d5b70fce, user_id=7fb11375c5c542b58cb9a579f59327b4, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:33.914847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:33.984981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1271/2535] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:33 2022] PUT /identity/v3/projects/2df605cb28f54ec4a3133374d5b70fce/users/7fb11375c5c542b58cb9a579f59327b4/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:33.989105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:33.998929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8acc-f9e1-476c-834b-a56a74673e56 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:34.054051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:34.054706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.054981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.055250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.055963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:34.057595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9872-7a90-49f2-a989-c995e15a49cd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:34.067307 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1265/2536] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:34.072228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:34.082308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6286-8ead-4925-8140-885bf51efcef admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:34.086941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:34.087813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.088095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.088363 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] PATH_INFO: `/v3/projects/2df605cb28f54ec4a3133374d5b70fce/users/7fb11375c5c542b58cb9a579f59327b4/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.090347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df605cb28f54ec4a3133374d5b70fce, user_id=7fb11375c5c542b58cb9a579f59327b4, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:34.093250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:34.104015 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1272/2537] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:34 2022] PUT /identity/v3/projects/2df605cb28f54ec4a3133374d5b70fce/users/7fb11375c5c542b58cb9a579f59327b4/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:34.113913 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.114684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.114971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.141106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] MFA Rules not processed for user `7fb11375c5c542b58cb9a579f59327b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:34.142369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:34.216959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1266/2538] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:34.227264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:34.228939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:34.289191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f72c2-6613-4106-bfec-5e03ac26e019 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:34.292878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:34.293542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.293856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.294132 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.303930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:34.305383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe56a3-0c51-45a0-83c3-3d7ed552bbc5 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:34.315650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1273/2539] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:34.446621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:34.507889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42bed-8edf-428c-bddc-5cb299d55038 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:34.512465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:34.513331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.513613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.513918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] PATH_INFO: `/v3/users/4a583f84950f4a75ae7f2868fc8f2343` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.515092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a583f84950f4a75ae7f2868fc8f2343)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:34.517060 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:34.685301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a583f84950f4a75ae7f2868fc8f2343'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:34.691957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a583f84950f4a75ae7f2868fc8f2343'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:34.761801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a583f84950f4a75ae7f2868fc8f2343'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:34.778291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a583f84950f4a75ae7f2868fc8f2343'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:34.779131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7efb2247-68c1-4761-9378-f1d06ee0844b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a583f84950f4a75ae7f2868fc8f2343'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:34.789427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1267/2540] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:34 2022] DELETE /identity/v3/users/4a583f84950f4a75ae7f2868fc8f2343 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:34.791312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.792483 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.792758 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.813735 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:34.814948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:34.868446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.869296 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.870080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.878402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1274/2541] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:34.889852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:34.890621 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] MFA Rules not processed for user `c1ad3502a895428e96aa792a5c54cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:34.891212 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:34.892629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:34.953340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408be81d-5fd2-41fa-8df9-75cf55a1f022 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:34.961771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:34.962434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:34.962813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:34.963086 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:34.964268 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1268/2542] 10.222.0.24 () {58 vars in 967 bytes} [Fri Mar 25 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:34.975563 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:34.977627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:34.990696 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:34.990809 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1275/2543] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:38:34.990895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:35.069757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164fa04-dcfd-45e2-994d-401ea0f49dc0 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:35.075223 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5956fc6e9b848298d2623b191e841c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:35.075999 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:35.076465 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:35.076839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:35.086040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:35.087681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:35.096227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1269/2544] 10.222.0.24 () {60 vars in 1384 bytes} [Fri Mar 25 03:38:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 25 03:38:35.428273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:35.429835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:35.443523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65d08a-adb9-49c1-a67c-252790449221 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:35.448986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:35.449804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:35.450083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:35.450357 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] PATH_INFO: `/v3/projects/a7a7cf92136946d487a125855c9def67` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:35.451552 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a7cf92136946d487a125855c9def67)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:35.453541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:35.663738 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a7cf92136946d487a125855c9def67', 'request_id': 'req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:35.669429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a7cf92136946d487a125855c9def67', 'request_id': 'req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:35.676382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a7cf92136946d487a125855c9def67', 'request_id': 'req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:35.745419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] The token cache is being invalidate because project a7a7cf92136946d487a125855c9def67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:35.745740 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:35.746369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:35.748232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1276/2545] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:35 2022] DELETE /identity/v3/projects/a7a7cf92136946d487a125855c9def67 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:35.752154 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:35.763291 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1893-da87-4c56-9c10-6826a6809234 service swift] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:35.819315 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:35.820098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:35.820462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:35.820738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] PATH_INFO: `/v3/users/7fb11375c5c542b58cb9a579f59327b4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:35.822062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb11375c5c542b58cb9a579f59327b4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:35.824007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:36.046545 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb11375c5c542b58cb9a579f59327b4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:36.053973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb11375c5c542b58cb9a579f59327b4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:36.192207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb11375c5c542b58cb9a579f59327b4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:36.213650 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb11375c5c542b58cb9a579f59327b4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:36.214583 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e742d621-d641-4e5a-8328-8a7a51901aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb11375c5c542b58cb9a579f59327b4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:36.224298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1270/2546] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:35 2022] DELETE /identity/v3/users/7fb11375c5c542b58cb9a579f59327b4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:36.776289 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:36.787643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:36.803876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846d29-9e6f-4eb3-bdbf-8a97fa72955c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:36.927463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:36.928343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:36.928616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:36.928890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] PATH_INFO: `/v3/projects/2df605cb28f54ec4a3133374d5b70fce` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:36.930331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df605cb28f54ec4a3133374d5b70fce)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:36.932337 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.077280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df605cb28f54ec4a3133374d5b70fce', 'request_id': 'req-0e9dc982-eb2e-4ba4-b594-2269a99e5508'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:37.084524 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df605cb28f54ec4a3133374d5b70fce', 'request_id': 'req-0e9dc982-eb2e-4ba4-b594-2269a99e5508'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:37.091650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df605cb28f54ec4a3133374d5b70fce', 'request_id': 'req-0e9dc982-eb2e-4ba4-b594-2269a99e5508'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:37.196933 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] The token cache is being invalidate because project 2df605cb28f54ec4a3133374d5b70fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:37.197478 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:37.198300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-0e9dc982-eb2e-4ba4-b594-2269a99e5508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:37.202792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1277/2547] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:36 2022] DELETE /identity/v3/projects/2df605cb28f54ec4a3133374d5b70fce => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:37.211434 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.212333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.213384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.233722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:37.235368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:37.302840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1271/2548] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:37.310686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.310971 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.311484 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.330102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:37.331907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:37.340454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1278/2549] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:37.345069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.356550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7da6-de1f-46da-8b72-cff329002964 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.361412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.362128 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.362411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.362687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.363398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:37.363692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.365310 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.378144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1272/2550] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:37.384192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.394900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12334acd-65a6-4a7b-9357-017669ada3da None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.406356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.407042 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.407322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.407725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.408313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.410342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.535892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1279/2551] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:37 2022] POST /identity/v3/projects => generated 409 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:37.540250 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.551113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4701e-d94c-45a8-9e6d-2e4ad39448ed admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.613311 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.614236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.614375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.614563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.615261 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.617227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.717776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1273/2552] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:37 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:37.721869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.732459 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f137-44b6-4a4a-b3c8-843193b3c642 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.737342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.738064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.738350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.738651 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.739418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.741077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.752411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1280/2553] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:37.757422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.768254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754b63c-3c76-47f8-8202-8028e78e9d2f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.774011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.775463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.775756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.776026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.776754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.778772 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af572d-775c-4ee6-b934-6490e2fb2e31 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.790364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1274/2554] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:37.797488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:37.809192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64042365-1b2f-4b21-80c0-3332f5105364 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:37.814100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:37.814987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.815271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.815573 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] PATH_INFO: `/v3/projects/ed84589023aa41548540a9b342d605cd/users/79320443e6b640c6a574e9c5992e9cf4/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:37.846335 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed84589023aa41548540a9b342d605cd, user_id=79320443e6b640c6a574e9c5992e9cf4, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:37.846436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:37.947075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1281/2555] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:37 2022] PUT /identity/v3/projects/ed84589023aa41548540a9b342d605cd/users/79320443e6b640c6a574e9c5992e9cf4/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:37.962576 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:37.962865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:37.963136 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.001026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] MFA Rules not processed for user `79320443e6b640c6a574e9c5992e9cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:38.002397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:38.073574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1275/2556] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:38.078811 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.141824 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae48c-7cbb-46ae-9450-a03a0836c22a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.146517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.147170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.147440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.147713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.148396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.150355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.245747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1282/2557] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:38 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:38.249423 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.260441 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3cf83-ddda-4de0-9116-98ee298da2fd None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.333146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.334821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.335334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.349477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.349477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.350345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.440591 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1276/2558] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:38 2022] POST /identity/v3/users => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:38.441798 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.453637 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42cb5-0a05-4740-8a76-3d6ef755a527 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.461543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.462252 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.463389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.463881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.464916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.466678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.479145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1283/2559] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:38.483145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.494379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7132-331a-49b6-bf8f-f085b6bbaca7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.500019 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.501246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.502030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.502314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] PATH_INFO: `/v3/projects/412963670ced4a108d58cb132540f6a3/users/9c4ab45487e44328b0749ba69f13c237/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.519428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412963670ced4a108d58cb132540f6a3, user_id=9c4ab45487e44328b0749ba69f13c237, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.522773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.618672 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1277/2560] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:38 2022] PUT /identity/v3/projects/412963670ced4a108d58cb132540f6a3/users/9c4ab45487e44328b0749ba69f13c237/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:38.623032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.637901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da307-933b-4b22-a2b1-439b8737289e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.657147 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.660021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:38.720245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.720912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.721191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.721464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.722229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.724419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.735003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1284/2561] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:38.739039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.744299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89df26-49bc-442e-8b05-900b50698566 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.749221 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.749726 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b767-f076-45ef-9cf9-9a8816ea964f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:38.750322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.750534 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.750812 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] PATH_INFO: `/v3/users/6b6e9bb441c145e9a2d1d408d27c7dbd` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.752024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6e9bb441c145e9a2d1d408d27c7dbd)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.754046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.756151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:38.757283 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.757769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.758195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] PATH_INFO: `/v3/projects/412963670ced4a108d58cb132540f6a3/users/9c4ab45487e44328b0749ba69f13c237/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.760604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412963670ced4a108d58cb132540f6a3, user_id=9c4ab45487e44328b0749ba69f13c237, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:38.764261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf7c8d-e050-42a0-b715-f7395c2e8780 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:38.779632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1285/2562] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:38 2022] PUT /identity/v3/projects/412963670ced4a108d58cb132540f6a3/users/9c4ab45487e44328b0749ba69f13c237/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:38.790863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:38.791282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:38.791566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:38.824315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] MFA Rules not processed for user `9c4ab45487e44328b0749ba69f13c237`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:38.826894 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:38.911750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1286/2563] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:38.922688 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:38.924062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:38.957742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6e9bb441c145e9a2d1d408d27c7dbd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:38.971282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6e9bb441c145e9a2d1d408d27c7dbd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:38.994887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2bb39-3b50-454b-ad9d-3586139d0700 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:39.000268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:39.000974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.001194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.001466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.012159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:39.013616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:39.024052 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1287/2564] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:38:39.057835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6e9bb441c145e9a2d1d408d27c7dbd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.072193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6e9bb441c145e9a2d1d408d27c7dbd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.072803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6e9bb441c145e9a2d1d408d27c7dbd'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.079099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1278/2565] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:38 2022] DELETE /identity/v3/users/6b6e9bb441c145e9a2d1d408d27c7dbd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:39.346317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:39.405456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:39.407024 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:39.425410 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5d6f6-c297-45f1-af46-72ad12132779 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:39.463124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943ae8-ef91-46a6-ba90-4b6b32d21bb9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:39.467053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:39.467692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.467980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.468257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.470159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:39.482520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:39.483360 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.485929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.485929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] PATH_INFO: `/v3/projects/8c145ebf662a44dba276dde5bb33a5f9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.485929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c145ebf662a44dba276dde5bb33a5f9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:39.487294 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:39.531396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:39.532871 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275238b-c36c-44d5-af3a-160798a91b29 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:39.541756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1279/2566] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:38:39.624082 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c145ebf662a44dba276dde5bb33a5f9', 'request_id': 'req-2b162f24-9262-46b2-967d-7f1400496c95'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.629492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c145ebf662a44dba276dde5bb33a5f9', 'request_id': 'req-2b162f24-9262-46b2-967d-7f1400496c95'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.636197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c145ebf662a44dba276dde5bb33a5f9', 'request_id': 'req-2b162f24-9262-46b2-967d-7f1400496c95'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.739977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] The token cache is being invalidate because project 8c145ebf662a44dba276dde5bb33a5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:39.740351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.740999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-2b162f24-9262-46b2-967d-7f1400496c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:39.742609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1288/2567] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:39 2022] DELETE /identity/v3/projects/8c145ebf662a44dba276dde5bb33a5f9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:39.747723 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.748017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.748290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.765632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:39.766850 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:39.835715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1280/2568] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:39.886619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.887182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.887182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.905435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:39.906998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:39.915281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1289/2569] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:39.919463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:39.929690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdad97-05fe-4b39-b7a3-19f142b4771e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:39.934312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:39.934958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.935243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.935520 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.936265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:39.936570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:39.938230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:39.949881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1281/2570] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:39.954226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:39.963468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac6fa-e029-4376-aa89-e6eea5817f14 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:39.968590 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:39.972383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:39.972383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:39.972383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:39.972383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:39.972769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.099905 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1290/2571] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:39 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:40.104247 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:40.114109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c912696-5e9d-4c8b-b15f-e5761e7cdff7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:40.168656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:40.169312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.169597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.169903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.170607 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:40.172555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.275430 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1282/2572] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:40 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:40.282681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:40.293603 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bfac-feef-406f-a2b3-9444a514104f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:40.298187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:40.298831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.299106 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.299373 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.300076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:40.301760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.315610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1291/2573] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:40.316834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:40.327279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a643c59-4101-45fd-a1a6-70dec987db05 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:40.331971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:40.332602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.333426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.333726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.334439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:40.336092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d03094-70d4-497a-b86e-3e50e42862c1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.346735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1283/2574] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:40.351597 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:40.361354 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9aa8-6766-4b73-8ee9-c81d32d39ed7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:40.366083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:40.367012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.367290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.367554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] PATH_INFO: `/v3/projects/bb859f2084f94f8aa3a3cbb63cb55417/users/2edddbdeab8e419cafbf108216aa27c0/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.382856 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb859f2084f94f8aa3a3cbb63cb55417, user_id=2edddbdeab8e419cafbf108216aa27c0, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:40.385759 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.523278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1292/2575] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:40 2022] PUT /identity/v3/projects/bb859f2084f94f8aa3a3cbb63cb55417/users/2edddbdeab8e419cafbf108216aa27c0/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:40.538784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.539266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.539393 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.565192 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] MFA Rules not processed for user `2edddbdeab8e419cafbf108216aa27c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:40.566599 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:40.631382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1284/2576] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:40.653232 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:40.654949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:40.710119 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f44644-2144-4f00-a048-877aa5891bba admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:40.713743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:40.714388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:40.714669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:40.714942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:40.723948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:40.725430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:40.734672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1293/2577] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:41.964280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:41.965858 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:42.022686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a57a-01b8-4f35-91bb-0c94d6555292 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:42.026278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:42.026906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:42.027186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:42.027456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:42.029206 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:42.093163 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:42.094753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:42.104945 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1285/2578] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:45.430513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:45.435805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:45.456822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc50b9b-f75f-4ebc-a22e-12c9ffddef54 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:45.465066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:45.465066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:45.465066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:45.465066 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:45.466570 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:45.491058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:45.492610 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:45.504488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1294/2579] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:46.147854 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:46.149715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:46.164769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359e31-39bc-497a-a5f0-58c913004ed2 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:46.171025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:46.171978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:46.172259 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:46.172710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] PATH_INFO: `/v3/users/0092d4e191b14af3b1f799271c19fa73` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:46.174184 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0092d4e191b14af3b1f799271c19fa73)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:46.177438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:46.455580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0092d4e191b14af3b1f799271c19fa73'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:46.462349 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0092d4e191b14af3b1f799271c19fa73'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:46.545306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0092d4e191b14af3b1f799271c19fa73'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:46.559559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0092d4e191b14af3b1f799271c19fa73'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:46.560336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-00857634-ca18-46d0-add0-54a7400319be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0092d4e191b14af3b1f799271c19fa73'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:46.566743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1286/2580] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:46 2022] DELETE /identity/v3/users/0092d4e191b14af3b1f799271c19fa73 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:46.923164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:46.933619 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4577f-3da2-47ff-b2ae-24b927ab50ed service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.022991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.024114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.024398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.024677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] PATH_INFO: `/v3/projects/cb503745eeb5421c88b2fe9a4ef78921` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.026092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb503745eeb5421c88b2fe9a4ef78921)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.028671 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.174077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb503745eeb5421c88b2fe9a4ef78921', 'request_id': 'req-e321bcb2-1f44-4479-a30f-6014785c205d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:47.179398 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb503745eeb5421c88b2fe9a4ef78921', 'request_id': 'req-e321bcb2-1f44-4479-a30f-6014785c205d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:47.185898 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb503745eeb5421c88b2fe9a4ef78921', 'request_id': 'req-e321bcb2-1f44-4479-a30f-6014785c205d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:47.260551 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] The token cache is being invalidate because project cb503745eeb5421c88b2fe9a4ef78921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:47.260860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:47.262235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e321bcb2-1f44-4479-a30f-6014785c205d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:47.264031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1295/2581] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:46 2022] DELETE /identity/v3/projects/cb503745eeb5421c88b2fe9a4ef78921 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:47.269333 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.269862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.270131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.288713 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:47.289965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:47.359243 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1287/2582] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:47.368470 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.368835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.369217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.388099 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:47.389389 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:47.400976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1296/2583] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:47.402341 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.413697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98691b-7894-4cb0-a4af-91cc5b14ff43 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.418762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.419573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.419809 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.420089 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.420805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:47.421111 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.422731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.437035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1288/2584] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:47.441536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.452670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918559f5-a10f-40cc-9d44-a6dfbe958ec7 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.459523 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.463400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.463400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.463400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.463400 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.464178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.563640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1297/2585] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:47 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:47.567944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.584072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f029cd-132d-4523-852b-a9b769304bc6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.698244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.699733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.700212 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.700673 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.702480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.704732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.782866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1289/2586] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:47 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:47.784198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.798183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb07-bd35-4669-96e0-149a4be4333f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.803943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.804609 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.804885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.805154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.805954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.807698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.820448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1298/2587] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:47.824186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.836321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473e0e-9460-4547-b344-53be47213bf9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.849861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.850724 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.851140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.851428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.852386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.854628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a583b21-21eb-42b8-87f6-021a8f405c72 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:47.885699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1290/2588] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:47.891243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:47.903011 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003170d-b521-4432-a320-aeb23d49a903 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:47.908776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:47.909689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:47.909982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:47.910256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] PATH_INFO: `/v3/projects/2a13372338354727aba4b68b8c8093e2/users/5ed9c669260f4603b50106130a3bcf1e/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:47.928257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a13372338354727aba4b68b8c8093e2, user_id=5ed9c669260f4603b50106130a3bcf1e, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:47.931107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.016732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.017098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.017468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.019355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1299/2589] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:47 2022] PUT /identity/v3/projects/2a13372338354727aba4b68b8c8093e2/users/5ed9c669260f4603b50106130a3bcf1e/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:48.052983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] MFA Rules not processed for user `5ed9c669260f4603b50106130a3bcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:48.054771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:48.174835 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1291/2590] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:48.179769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.244139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f94a1-6f5d-4c9e-940c-0a62fbb91335 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.248932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.249591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.250034 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.250229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.250918 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.253187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.380869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1300/2591] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:48 2022] POST /identity/v3/projects => generated 401 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:48.384881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.402392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c984b-09b5-4e77-bcdb-4eaae34d74c9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.477446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.478319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.478801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.479239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.480193 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.482616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.606256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1292/2592] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:48 2022] POST /identity/v3/users => generated 307 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:48.610074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.621443 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d97a-39fe-4a6c-a1e7-cc0f95da58ee admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.627394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.628145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.628428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.628703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.629995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.631608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.643448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1301/2593] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:48.648581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.672791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cc4db-9d76-4a35-a63e-e4abff6f321a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.677617 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.678731 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.679080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.679425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] PATH_INFO: `/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4/users/388615954fb74a0db6dfbebdd97951b3/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.701580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9c9b6c19b24438b46f6536795bb6d4, user_id=388615954fb74a0db6dfbebdd97951b3, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.714162 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.824817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1293/2594] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:48 2022] PUT /identity/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4/users/388615954fb74a0db6dfbebdd97951b3/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:48.830844 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.851007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f439a84-b2d2-4382-a0eb-e9d7b586e0a2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.917027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.918468 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.919138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.919598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.920546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.922420 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290401-555b-40fe-aca6-88b46cadcd17 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:48.933062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1302/2595] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:48.937224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:48.952332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e174-e376-4f14-9fec-4d77d5884873 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:48.969146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:48.970182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:48.970538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:48.970831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] PATH_INFO: `/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4/users/388615954fb74a0db6dfbebdd97951b3/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:48.973604 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9c9b6c19b24438b46f6536795bb6d4, user_id=388615954fb74a0db6dfbebdd97951b3, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:48.976641 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:49.003710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1294/2596] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:48 2022] PUT /identity/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4/users/388615954fb74a0db6dfbebdd97951b3/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:49.014490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:49.015009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:49.015439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:49.052239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] MFA Rules not processed for user `388615954fb74a0db6dfbebdd97951b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:49.053490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:49.136843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1303/2597] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:49.148994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:49.150748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:49.269919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c65a4-32d9-47db-93c5-a07dfb73b7e0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:49.275519 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:49.276750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:49.277248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:49.277853 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:49.296001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:49.297927 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:49.325457 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1295/2598] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:49.737458 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:49.749227 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d857-d2ba-4914-91fa-ddacce42add1 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:49.753017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:49.753682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:49.753978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:49.754261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:49.812186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:49.813684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:49.822854 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1304/2599] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:49.989364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:49.996051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:49.996394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:49.998935 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:50.071855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f43ae-46b3-47aa-bc4e-7ba81da47bfa service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:50.076558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:50.077124 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d20dd3-2be2-419c-b09d-83d318b6ffdd service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:50.077420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:50.078174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:50.078174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] PATH_INFO: `/v3/users/bbc60b26fb424ad78dc6d86b5da15b0f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:50.079252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc60b26fb424ad78dc6d86b5da15b0f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:50.081170 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:50.081968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:50.083825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:50.084115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:50.084620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] PATH_INFO: `/v3/users/79320443e6b640c6a574e9c5992e9cf4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:50.085878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79320443e6b640c6a574e9c5992e9cf4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:50.087863 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:50.294930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc60b26fb424ad78dc6d86b5da15b0f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.300007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79320443e6b640c6a574e9c5992e9cf4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.302331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc60b26fb424ad78dc6d86b5da15b0f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.307428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79320443e6b640c6a574e9c5992e9cf4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.320029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79320443e6b640c6a574e9c5992e9cf4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.320720 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79320443e6b640c6a574e9c5992e9cf4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.397160 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc60b26fb424ad78dc6d86b5da15b0f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.409284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc60b26fb424ad78dc6d86b5da15b0f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.409944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ed424ec0-32b3-41cf-bbda-d77e78ec21d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc60b26fb424ad78dc6d86b5da15b0f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.415839 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1296/2600] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:49 2022] DELETE /identity/v3/users/bbc60b26fb424ad78dc6d86b5da15b0f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:50.493687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79320443e6b640c6a574e9c5992e9cf4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.506911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1305/2601] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:49 2022] DELETE /identity/v3/users/79320443e6b640c6a574e9c5992e9cf4 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:50.507323 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:50.507690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:50.507974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:50.535355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:50.536679 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:50.611781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1297/2602] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:50.634669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:50.634669 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:50.680643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e99e1-43b9-47cd-90b8-7e886c0a3787 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:50.684461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:50.685109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:50.685496 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:50.685801 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:50.695334 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:50.696792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2326547-edf6-49fe-b10c-37c0b2b28585 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:50.706394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1306/2603] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:50.741563 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:50.743439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:50.756638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff23d-eae0-4c83-8611-148031d62798 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:50.763791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:50.764864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:50.765353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:50.765614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] PATH_INFO: `/v3/projects/680fe419d6a44ddcb8a1965b421ce8e9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:50.767329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680fe419d6a44ddcb8a1965b421ce8e9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:50.769421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:50.922070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680fe419d6a44ddcb8a1965b421ce8e9', 'request_id': 'req-e900d895-1e33-430b-9366-911261693c39'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:50.929218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680fe419d6a44ddcb8a1965b421ce8e9', 'request_id': 'req-e900d895-1e33-430b-9366-911261693c39'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.029044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680fe419d6a44ddcb8a1965b421ce8e9', 'request_id': 'req-e900d895-1e33-430b-9366-911261693c39'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.041577 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] The token cache is being invalidate because project 680fe419d6a44ddcb8a1965b421ce8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:51.041919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.042573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e900d895-1e33-430b-9366-911261693c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.044121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1298/2604] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:50 2022] DELETE /identity/v3/projects/680fe419d6a44ddcb8a1965b421ce8e9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:51.049693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.050218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.050502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.075424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:51.075424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.140488 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1307/2605] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:51.149344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.149728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.150095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.168726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:51.176900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.177928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1299/2606] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:51.182392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.192871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b6c95-4a26-48f4-911e-85da3f101aff None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.197569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.198256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.198532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.199181 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.199510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:51.199812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.201506 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.213632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1308/2607] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:51.221330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.221749 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.223741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.232377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fd58-d3a1-4f18-934d-bfeee621d613 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.242937 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.243642 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.243923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.244198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.244886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.247157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.255695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1395-1c75-4157-b14f-affda6006eac None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.260384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.261251 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.261529 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.261834 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] PATH_INFO: `/v3/projects/ed84589023aa41548540a9b342d605cd` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.263000 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed84589023aa41548540a9b342d605cd)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.264907 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.403648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1309/2608] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:51.410386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.442100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed84589023aa41548540a9b342d605cd', 'request_id': 'req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.448054 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed84589023aa41548540a9b342d605cd', 'request_id': 'req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.470197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22081-7f86-416e-b66c-9d42f275ba92 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.524901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.525571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.525968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.526246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.526949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.528871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.533357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed84589023aa41548540a9b342d605cd', 'request_id': 'req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.545003 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] The token cache is being invalidate because project ed84589023aa41548540a9b342d605cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:51.545287 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.545966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.547514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1300/2609] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:51 2022] DELETE /identity/v3/projects/ed84589023aa41548540a9b342d605cd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:51.551500 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.553438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.569406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87fd8-16e8-4110-9cb9-bba65f5e9f88 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.573908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.574859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.575149 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.575429 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] PATH_INFO: `/v3/users/9c4ab45487e44328b0749ba69f13c237` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.576647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4ab45487e44328b0749ba69f13c237)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.588132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.629533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1310/2610] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:51.635877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.637641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.649806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b2f03-3b95-482b-89a9-3061df72bc38 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.654655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.655315 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.655598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.655876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.656702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.658351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.671892 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1311/2611] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:51.673163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.683408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc73c2c-b9b8-4456-8e6d-4be680712e04 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.688191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.688845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.689128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.689407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.690168 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.691783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.703594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1312/2612] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:51.707841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.718164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d8eb-ad4a-4024-be4f-56350709a0d4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:51.722934 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:51.724276 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.724545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.724807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] PATH_INFO: `/v3/projects/fabe60256f834ffb9cad941af89a7f2b/users/3b8bf22e5bee4a4684a86d90521fd8eb/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.738976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabe60256f834ffb9cad941af89a7f2b, user_id=3b8bf22e5bee4a4684a86d90521fd8eb, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:51.742473 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1a23-6c4b-4272-9a35-89a6586d72cd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:51.810574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4ab45487e44328b0749ba69f13c237'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.817065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4ab45487e44328b0749ba69f13c237'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.831302 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1313/2613] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:51 2022] PUT /identity/v3/projects/fabe60256f834ffb9cad941af89a7f2b/users/3b8bf22e5bee4a4684a86d90521fd8eb/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:51.842411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:51.842702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:51.842977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:51.869076 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] MFA Rules not processed for user `3b8bf22e5bee4a4684a86d90521fd8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:51.870356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:51.916595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4ab45487e44328b0749ba69f13c237'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.930996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4ab45487e44328b0749ba69f13c237'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.931773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4ab45487e44328b0749ba69f13c237'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:51.933214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1314/2614] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:51.937384 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:51.938486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1301/2615] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:51 2022] DELETE /identity/v3/users/9c4ab45487e44328b0749ba69f13c237 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:52.000899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959a82-726a-4d1f-b7bc-1a0d86cd16af None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.056655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.057307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.057583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.059244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.059928 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.061861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.159342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1315/2616] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:51 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:52.164007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.176319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.195541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ea55-421b-4cdc-b280-0fe249c9d6a2 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.265754 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.266432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.266715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.266986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.267671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.270338 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.398397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1302/2617] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:52 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:52.402476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.413192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391057b-826d-4fd1-b807-c7ef935130b3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.417773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.418456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.418741 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.419074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.419797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.421448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.428714 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.430732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.435520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1316/2618] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:52.437393 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.444385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838df71-d7cd-4b76-9c46-35113d9d739b admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.449237 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df4cd-8bf9-4179-9b28-7644499be75b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.450566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.451613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.452118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.452422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] PATH_INFO: `/v3/projects/412963670ced4a108d58cb132540f6a3` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.453738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=412963670ced4a108d58cb132540f6a3)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.455864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.456508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.457521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.457923 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.458900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] PATH_INFO: `/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9/users/ed5b348e30d140fabf8fe4e2b555e55b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.475448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31bc55e4ec64dafbbb52d9412ebf0e9, user_id=ed5b348e30d140fabf8fe4e2b555e55b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.478350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.556667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1317/2619] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:52 2022] PUT /identity/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9/users/ed5b348e30d140fabf8fe4e2b555e55b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:52.560545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.597308 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412963670ced4a108d58cb132540f6a3', 'request_id': 'req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:52.602941 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412963670ced4a108d58cb132540f6a3', 'request_id': 'req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:52.620331 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6aaf3-b668-4acc-b56d-e83c5621103e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.676736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.677403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.677701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.677985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.678697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.680290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.689911 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1318/2620] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:52.694698 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.704024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e09-620e-4561-a4f2-66588c58fcd7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.709107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.709977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.710261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.710530 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] PATH_INFO: `/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9/users/ed5b348e30d140fabf8fe4e2b555e55b/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.712507 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31bc55e4ec64dafbbb52d9412ebf0e9, user_id=ed5b348e30d140fabf8fe4e2b555e55b, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.715129 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241f8d7-85c0-44d9-b5b5-9bc4cf74b25c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.725198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1319/2621] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:52 2022] PUT /identity/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9/users/ed5b348e30d140fabf8fe4e2b555e55b/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:52.727961 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412963670ced4a108d58cb132540f6a3', 'request_id': 'req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:52.735278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.735572 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.738158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.740924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] The token cache is being invalidate because project 412963670ced4a108d58cb132540f6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:52.741281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:52.741957 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-ebceffbc-05ec-4be3-ac3c-becf1588b5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:52.744789 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1303/2622] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:52 2022] DELETE /identity/v3/projects/412963670ced4a108d58cb132540f6a3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:52.748759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551acb-cd81-4b1f-8d9c-94823bf1eb8a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.749044 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551acb-cd81-4b1f-8d9c-94823bf1eb8a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.749316 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551acb-cd81-4b1f-8d9c-94823bf1eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.767249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-49551acb-cd81-4b1f-8d9c-94823bf1eb8a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:52.767774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] MFA Rules not processed for user `ed5b348e30d140fabf8fe4e2b555e55b`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:52.769001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-49551acb-cd81-4b1f-8d9c-94823bf1eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.769115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.826306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1304/2623] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:52.834083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.834368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.838410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.838531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1320/2624] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:52.848710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.850120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.853707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:52.854880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:52.862865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1305/2625] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:52.867431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.876228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d8cc-d3e8-403d-87fe-27eee2b524d2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.881462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.886105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.904439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1306/2626] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:38:52.905688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:52.909746 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12c059-3eee-4b9e-b6e3-a2e69687f0a9 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.913605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.914282 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.914562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.914970 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.917403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f483469-9e8c-4834-b559-03915effc980 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:52.922479 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:52.924269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:52.924269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:52.924269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:52.924549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.924757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:52.925589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.926710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:52.941791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1321/2627] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:38:53.043734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1307/2628] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:52 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:53.047976 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.058960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064d39-1c23-401e-a399-76bbdc40bc13 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.116424 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.117107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.117371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.117645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.118361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.120347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.195901 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.249446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1322/2629] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:53 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:53.250792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.252081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002cdf-9ef0-429f-8d8c-aa5129627a6a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.255763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.256413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.256692 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.256967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.258898 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:53.260843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4f6f-681c-462a-839b-d4382590106f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.265617 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.266296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.266577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.266853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.267565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.269159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.290024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1323/2630] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:53.290024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.296321 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255cb48-5a8e-4e50-84ef-1c88cd41efbe admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.300938 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.301656 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.302047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.302314 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.303558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.305244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.321004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.321151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1324/2631] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:53.321990 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.322710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b00be-0014-457b-87cb-0ce6398d1a0d service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.331879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51715a-c483-4b5f-8a57-a36b21d3e2e2 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.332326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1308/2632] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:53.336699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.337614 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.338072 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.338249 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] PATH_INFO: `/v3/projects/2ca9f7ea97954276b25602bda2fc96a4/users/94f547a46ad94d0ab4152fd1682d896d/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.354986 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca9f7ea97954276b25602bda2fc96a4, user_id=94f547a46ad94d0ab4152fd1682d896d, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.357646 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.486830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1325/2633] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:53 2022] PUT /identity/v3/projects/2ca9f7ea97954276b25602bda2fc96a4/users/94f547a46ad94d0ab4152fd1682d896d/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:53.498900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.499369 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.499720 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.528662 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] MFA Rules not processed for user `94f547a46ad94d0ab4152fd1682d896d`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:53.530051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:53.600240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1309/2634] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:53.604677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.668695 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4fd1-22d0-42b8-9ce1-42763530184a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.673430 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.674115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.674397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.674675 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.675352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.677270 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.763374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1326/2635] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:53 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:53.767336 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.778440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d75403-32e2-47ae-a8de-4cc706c74fcb None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.837978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.838821 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.839100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.839419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.840104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.842409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.962644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.964673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:53.967248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1310/2636] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:53 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:53.972037 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:53.979422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e32-3b4f-4176-b846-4c5af0e24831 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.982248 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082a1d-c6bc-474e-9c76-338cfcb9588e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:53.984149 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.985048 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.985330 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.985604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] PATH_INFO: `/v3/users/2edddbdeab8e419cafbf108216aa27c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.986889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:53.987032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2edddbdeab8e419cafbf108216aa27c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.987550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:53.987843 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:53.988113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:53.988830 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:53.988979 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:53.991456 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.002598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1311/2637] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:54.006977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.017335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542415-9f04-40a4-9c3e-86dbfec1c829 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.022805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.023438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.023717 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.023986 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.024687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.026401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.036568 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1312/2638] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:54.040496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.049548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19378459-a424-46e5-b229-a555b04e6369 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.054100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.054906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.055182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.055451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] PATH_INFO: `/v3/projects/563860a1ced84fa69a4d791bbeb15df4/users/59e2cd2ab6f041ec84230f517550b3bb/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.069507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=563860a1ced84fa69a4d791bbeb15df4, user_id=59e2cd2ab6f041ec84230f517550b3bb, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.072123 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d85f-df85-4600-a777-1cc76014d6ae admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.184810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1313/2639] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:54 2022] PUT /identity/v3/projects/563860a1ced84fa69a4d791bbeb15df4/users/59e2cd2ab6f041ec84230f517550b3bb/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:54.195231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.195515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.195786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.221647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] MFA Rules not processed for user `59e2cd2ab6f041ec84230f517550b3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:54.222317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2edddbdeab8e419cafbf108216aa27c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:54.222870 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:54.228517 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2edddbdeab8e419cafbf108216aa27c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:54.240278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2edddbdeab8e419cafbf108216aa27c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:54.240987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2edddbdeab8e419cafbf108216aa27c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:54.287715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1314/2640] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:54.292331 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.293596 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:54.299975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-aa4c87e9-328d-4025-bccd-9f2363db7a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2edddbdeab8e419cafbf108216aa27c0'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:54.308310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1327/2641] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:53 2022] DELETE /identity/v3/users/2edddbdeab8e419cafbf108216aa27c0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:54.313259 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.313643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.314080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.332105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:54.333433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:54.359470 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8209-d731-4d85-bf26-85ab1846e716 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.390514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1328/2642] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:54.400043 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.401408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:54.413875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.414454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.414737 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.415010 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.415684 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.417595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.456166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3bb8-9f8d-4826-80c7-4fe407a7bd24 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.459774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.460415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.460693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.460965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.469891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.471327 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.480808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1329/2643] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:38:54.498994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1315/2644] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:54.503012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.513382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381a70-972b-42fb-a191-c362d9c87888 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.569223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.569927 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.570211 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.570486 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.571198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.573162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.678386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1330/2645] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:54 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:54.679895 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.691267 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4179-3b40-4389-a656-57c775c41840 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.697046 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.698102 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.698548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.699194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.700588 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.702934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.716744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1316/2646] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:54.721105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.732672 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b040c-56f7-4e28-b512-f56176657cee admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.738241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.739356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.740114 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.740388 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] PATH_INFO: `/v3/projects/c39caf47287048538d1d8ce05b9d3dab/users/31d057622662401d95949d1a7a53b68f/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.757645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39caf47287048538d1d8ce05b9d3dab, user_id=31d057622662401d95949d1a7a53b68f, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.760989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.894137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1331/2647] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:54 2022] PUT /identity/v3/projects/c39caf47287048538d1d8ce05b9d3dab/users/31d057622662401d95949d1a7a53b68f/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:54.898242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.908280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b212c3-8c4a-411e-8f50-c33c1e04e76c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.970750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.971695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.972467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.972602 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:54.972795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.973016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.974398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:54.975845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:54.988214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a52e61-0d13-4c14-aa5b-a610e58a0ac3 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:54.991205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1317/2648] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:54.992101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:54.996280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:54.997151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:54.997426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:54.997722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] PATH_INFO: `/v3/projects/bb859f2084f94f8aa3a3cbb63cb55417` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:54.999068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb859f2084f94f8aa3a3cbb63cb55417)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:55.002198 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:55.002391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d45dcb-4bee-4da7-9a5e-b939f86c6b50 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:55.007197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:55.008080 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.008838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.008838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] PATH_INFO: `/v3/projects/c39caf47287048538d1d8ce05b9d3dab/users/31d057622662401d95949d1a7a53b68f/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.010709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39caf47287048538d1d8ce05b9d3dab, user_id=31d057622662401d95949d1a7a53b68f, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:55.013706 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f41cf-bd55-4c50-aa7a-a52c84ecb4f3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:55.025386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1318/2649] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:54 2022] PUT /identity/v3/projects/c39caf47287048538d1d8ce05b9d3dab/users/31d057622662401d95949d1a7a53b68f/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:55.041114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.041114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.041409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.068932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] MFA Rules not processed for user `31d057622662401d95949d1a7a53b68f`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:55.070270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.136810 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1319/2650] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:38:55.143064 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb859f2084f94f8aa3a3cbb63cb55417', 'request_id': 'req-edfd3151-42f0-43c6-981b-4ed5761fd87e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.149117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb859f2084f94f8aa3a3cbb63cb55417', 'request_id': 'req-edfd3151-42f0-43c6-981b-4ed5761fd87e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.156151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb859f2084f94f8aa3a3cbb63cb55417', 'request_id': 'req-edfd3151-42f0-43c6-981b-4ed5761fd87e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.160038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:55.162095 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.216648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fee7-8448-450f-b53c-631e2d14b413 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:55.234682 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] The token cache is being invalidate because project bb859f2084f94f8aa3a3cbb63cb55417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:55.235217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.235839 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.237657 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1332/2651] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:54 2022] DELETE /identity/v3/projects/bb859f2084f94f8aa3a3cbb63cb55417 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:38:55.270388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:55.271531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.271806 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.272074 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.274030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.344880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:55.347800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:55.357703 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1320/2652] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:55.451145 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:55.452622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.454541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:55.456020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.469313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994f06-6c8a-41fe-90d0-ab39640dcd27 service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:55.473446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:55.474145 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.474428 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.474698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.476485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.529606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3151-42f0-43c6-981b-4ed5761fd87e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:55.534239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:55.535117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.535397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.535670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] PATH_INFO: `/v3/users/5ed9c669260f4603b50106130a3bcf1e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.535776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:55.536969 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed9c669260f4603b50106130a3bcf1e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:55.537295 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16625a9-652e-4cdc-8cdd-9f53bc58eb43 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:55.538965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:55.547374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1321/2653] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:55.738975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed9c669260f4603b50106130a3bcf1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.746068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed9c669260f4603b50106130a3bcf1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.758679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed9c669260f4603b50106130a3bcf1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.759340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed9c669260f4603b50106130a3bcf1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.842347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed9c669260f4603b50106130a3bcf1e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:55.849757 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1333/2654] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:55 2022] DELETE /identity/v3/users/5ed9c669260f4603b50106130a3bcf1e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:55.854442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:55.854728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:55.855009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:55.882312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:55.883645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:55.952363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1322/2655] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:55.961208 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:55.962493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:56.020559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767533c-7596-40a5-9713-0f0ed424a882 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:56.024394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:56.025035 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:56.025316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:56.025589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:56.034598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:56.036128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:56.045562 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1334/2656] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:56.487540 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:56.488984 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:56.501903 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea2b61-593d-4070-9bf1-5e338831a401 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:56.507299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:56.508198 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:56.508645 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:56.508918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] PATH_INFO: `/v3/projects/2a13372338354727aba4b68b8c8093e2` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:56.510830 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a13372338354727aba4b68b8c8093e2)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:56.512807 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:56.699711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a13372338354727aba4b68b8c8093e2', 'request_id': 'req-e816a033-6a26-48cb-b962-a8868a1f2e7f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:56.705225 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a13372338354727aba4b68b8c8093e2', 'request_id': 'req-e816a033-6a26-48cb-b962-a8868a1f2e7f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:56.788654 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a13372338354727aba4b68b8c8093e2', 'request_id': 'req-e816a033-6a26-48cb-b962-a8868a1f2e7f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:56.800227 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] The token cache is being invalidate because project 2a13372338354727aba4b68b8c8093e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:56.800514 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:56.801135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:56.802697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1323/2657] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:56 2022] DELETE /identity/v3/projects/2a13372338354727aba4b68b8c8093e2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:56.806645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:56.815950 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9f17-440f-46e9-899d-22f7663774e4 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:56.869767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:56.870796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:56.871071 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:56.871340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] PATH_INFO: `/v3/users/388615954fb74a0db6dfbebdd97951b3` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:56.872499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388615954fb74a0db6dfbebdd97951b3)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:56.874439 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:57.107250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388615954fb74a0db6dfbebdd97951b3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.114209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388615954fb74a0db6dfbebdd97951b3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.125979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388615954fb74a0db6dfbebdd97951b3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.126680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388615954fb74a0db6dfbebdd97951b3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.228709 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-21ba4637-c583-4e19-a1a7-103656d19ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388615954fb74a0db6dfbebdd97951b3'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.234941 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1335/2658] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:38:56 2022] DELETE /identity/v3/users/388615954fb74a0db6dfbebdd97951b3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:57.624773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:57.626239 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:57.641996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816a033-6a26-48cb-b962-a8868a1f2e7f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:57.703960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:57.704796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:57.705076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:57.705346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] PATH_INFO: `/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:57.706547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9c9b6c19b24438b46f6536795bb6d4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:57.708490 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:57.854478 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9c9b6c19b24438b46f6536795bb6d4', 'request_id': 'req-4d3ccdc1-4657-41f3-af09-72b6b25384e2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.859744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9c9b6c19b24438b46f6536795bb6d4', 'request_id': 'req-4d3ccdc1-4657-41f3-af09-72b6b25384e2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.962209 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9c9b6c19b24438b46f6536795bb6d4', 'request_id': 'req-4d3ccdc1-4657-41f3-af09-72b6b25384e2'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.974689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] The token cache is being invalidate because project ec9c9b6c19b24438b46f6536795bb6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:38:57.975109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.975814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4d3ccdc1-4657-41f3-af09-72b6b25384e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:38:57.977363 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1324/2659] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:38:57 2022] DELETE /identity/v3/projects/ec9c9b6c19b24438b46f6536795bb6d4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:57.982223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:57.982719 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:57.982819 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.000542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:58.001749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:58.057851 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1336/2660] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:58.065609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.065920 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.066195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.084511 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:58.085725 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:58.095709 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1325/2661] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:58.104497 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.110170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f5d2-45a0-49d1-ab39-d9bb2c2ac4fd None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.114841 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.115495 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.115886 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.116059 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.121514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:38:58.121514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.121514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.133859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1337/2662] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:38:58.135032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.144685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5fff-2674-48b5-b14b-8b08857d9baf None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.154148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.154148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.154148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.154148 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.154570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.154570 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.257582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1326/2663] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:58 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:58.262206 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.272588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bccb4-9dc0-4ace-85f8-1a919c9304a9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.328712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.329305 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.329585 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.329887 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.330561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.332536 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.432056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1338/2664] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:58 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:38:58.436114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.446260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ede657-a8f2-406d-835c-7cee12093b24 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.450791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.451431 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.451710 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.452007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.452722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.454413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.468936 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1327/2665] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:38:58.472405 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.484807 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f5874-7e0c-45ee-895d-10eedd734f74 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.490242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.490968 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.491318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.491663 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.492377 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.494019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7a88-da7e-45fd-94b4-d1e02579e4e2 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.504250 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1339/2666] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:58.508397 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.518402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99386af-d674-4b6a-bc77-a185d36dfa08 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.523007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.523872 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.524151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.524421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] PATH_INFO: `/v3/projects/80c3f91364504d488919e2c4dbc6317f/users/f18e803ba84a46dfa81c09a41acb342e/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.540462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c3f91364504d488919e2c4dbc6317f, user_id=f18e803ba84a46dfa81c09a41acb342e, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.543560 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:58.768264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1328/2667] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:58 2022] PUT /identity/v3/projects/80c3f91364504d488919e2c4dbc6317f/users/f18e803ba84a46dfa81c09a41acb342e/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:58.780112 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.780396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.780667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.809921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] MFA Rules not processed for user `f18e803ba84a46dfa81c09a41acb342e`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:58.811158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:58.874423 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1340/2668] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:58.878840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:58.938189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538a2e-2180-4026-ba7c-e4dbd3eed7fa admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:58.942732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:58.943420 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:58.943700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:58.943974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:58.944640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:58.946580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.040353 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1329/2669] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:38:58 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:59.044638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.055077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51c6c1-8950-4de9-ac4a-7c743f2c707d None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.109437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.110161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.110441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.110715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.111403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.113366 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.196823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1341/2670] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:38:59 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:38:59.200869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.212769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d33d-4f70-41ab-83ca-20aab88e198c admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.217801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.218445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.218722 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.218991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.219694 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.221270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.231959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1330/2671] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:59.236081 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.246062 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858328-9453-4170-8a2c-b68ac86f501f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.250680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.253031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.253031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.253031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] PATH_INFO: `/v3/projects/44c923d7612b4b9aad98f2624a4ca76c/users/68462c5242384dfdb68e9efaf3f65e31/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.267650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c923d7612b4b9aad98f2624a4ca76c, user_id=68462c5242384dfdb68e9efaf3f65e31, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.270461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.343502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1342/2672] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:59 2022] PUT /identity/v3/projects/44c923d7612b4b9aad98f2624a4ca76c/users/68462c5242384dfdb68e9efaf3f65e31/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:59.347459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.357543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3a8d-7262-435c-ac62-90025fb55722 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.413260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.413989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.414274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.414549 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.415264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.416862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65a22f-951a-4399-b3e5-34961f10c09e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.426680 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1331/2673] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:38:59.430930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.442635 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743333-50fb-4d60-a3d8-65953299fa74 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.448107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.449083 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.449436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.449805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] PATH_INFO: `/v3/projects/44c923d7612b4b9aad98f2624a4ca76c/users/68462c5242384dfdb68e9efaf3f65e31/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.451899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c923d7612b4b9aad98f2624a4ca76c, user_id=68462c5242384dfdb68e9efaf3f65e31, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.454831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.466221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1343/2674] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:38:59 2022] PUT /identity/v3/projects/44c923d7612b4b9aad98f2624a4ca76c/users/68462c5242384dfdb68e9efaf3f65e31/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:38:59.476726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.477017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.477294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.503778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] MFA Rules not processed for user `68462c5242384dfdb68e9efaf3f65e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:38:59.504969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:59.570953 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1332/2675] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:38:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:38:59.581301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.583009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:38:59.638661 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3965df-35e6-44ae-891c-01547a6a58bf admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.642264 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.642897 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.643180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.643453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.652166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.653606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.662864 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1344/2676] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:38:59.762357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:38:59.772264 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba35366-e977-4ba7-b888-137f3c343857 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:38:59.775877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:38:59.776506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:38:59.776785 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:38:59.777057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:38:59.831337 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:38:59.832697 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012ed30-72ac-425e-a213-cb25b27181c3 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:38:59.842161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1333/2677] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:38:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:01.062126 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:01.063527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:01.128947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1611-2da6-49e8-a787-a7261433e3c9 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:01.133502 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:01.134397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:01.134679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:01.135317 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] PATH_INFO: `/v3/users/94f547a46ad94d0ab4152fd1682d896d` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:01.136821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f547a46ad94d0ab4152fd1682d896d)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:01.138865 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:01.414718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f547a46ad94d0ab4152fd1682d896d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:01.421797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f547a46ad94d0ab4152fd1682d896d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:01.433318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f547a46ad94d0ab4152fd1682d896d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:01.434118 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f547a46ad94d0ab4152fd1682d896d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:01.514515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f547a46ad94d0ab4152fd1682d896d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:01.522213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1345/2678] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:01 2022] DELETE /identity/v3/users/94f547a46ad94d0ab4152fd1682d896d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:01.529484 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:01.530011 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:01.530119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:01.547057 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:01.548304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:01.608426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1334/2679] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:01.619229 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:01.620654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:01.701135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d5f9d-21a3-42fa-88a0-e7d6b6f08694 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:01.704716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:01.705369 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:01.705658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:01.705977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:01.717306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:01.718818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:01.730755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1346/2680] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:02.270213 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:02.271814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:02.286411 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb04e-6389-4bc1-9802-8200d094f790 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:02.293833 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:02.295820 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:02.296661 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:02.299153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] PATH_INFO: `/v3/projects/2ca9f7ea97954276b25602bda2fc96a4` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:02.300646 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca9f7ea97954276b25602bda2fc96a4)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:02.303449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:02.414964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca9f7ea97954276b25602bda2fc96a4', 'request_id': 'req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.421460 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca9f7ea97954276b25602bda2fc96a4', 'request_id': 'req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.502496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca9f7ea97954276b25602bda2fc96a4', 'request_id': 'req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.514565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] The token cache is being invalidate because project 2ca9f7ea97954276b25602bda2fc96a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:02.516218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.516218 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.517215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1335/2681] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:02 2022] DELETE /identity/v3/projects/2ca9f7ea97954276b25602bda2fc96a4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:02.521061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:02.530827 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1112a-c364-4fd1-8a11-8fb6324395e8 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:02.588246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:02.589113 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:02.589397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:02.589686 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] PATH_INFO: `/v3/users/59e2cd2ab6f041ec84230f517550b3bb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:02.590866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e2cd2ab6f041ec84230f517550b3bb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:02.593092 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:02.803039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:02.804732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:02.877674 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaad7b-e997-43b1-83ac-b2f4499fec0a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:02.882935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:02.883552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:02.883838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:02.884137 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:02.885987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:02.897914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:02.899536 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:02.910030 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1336/2682] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:02.950482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e2cd2ab6f041ec84230f517550b3bb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.959115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e2cd2ab6f041ec84230f517550b3bb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.973725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e2cd2ab6f041ec84230f517550b3bb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:02.975204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e2cd2ab6f041ec84230f517550b3bb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.119979 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e2cd2ab6f041ec84230f517550b3bb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.127474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1347/2683] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:02 2022] DELETE /identity/v3/users/59e2cd2ab6f041ec84230f517550b3bb => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:03.202904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:03.205375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:03.221889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174be1-d862-4c81-bf5f-291343abc0ec service placement] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:03.281842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:03.282757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:03.283040 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:03.283312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] PATH_INFO: `/v3/users/f18e803ba84a46dfa81c09a41acb342e` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:03.284524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18e803ba84a46dfa81c09a41acb342e)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:03.286533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:03.534462 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18e803ba84a46dfa81c09a41acb342e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.541025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18e803ba84a46dfa81c09a41acb342e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.611426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18e803ba84a46dfa81c09a41acb342e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.619174 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:03.621555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:03.625263 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18e803ba84a46dfa81c09a41acb342e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.625932 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-121aeffa-a5a0-4bb9-9ed4-6aba5b6ae5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18e803ba84a46dfa81c09a41acb342e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.632156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1337/2684] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:03 2022] DELETE /identity/v3/users/f18e803ba84a46dfa81c09a41acb342e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:03.636647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:03.636963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:03.637107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b008f-b42e-4fdd-866b-bde850e0f780 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:03.637437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:03.664229 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:03.666438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:03.698805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:03.699589 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:03.699866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:03.700144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] PATH_INFO: `/v3/projects/563860a1ced84fa69a4d791bbeb15df4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:03.701385 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563860a1ced84fa69a4d791bbeb15df4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:03.703303 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:03.727197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1338/2685] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:03.737047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:03.738252 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:03.793584 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f924fd-84a0-4bef-898d-3e527e0c2d48 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:03.797416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:03.798081 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:03.798357 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:03.798657 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:03.808228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:03.809644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:03.818925 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1339/2686] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:03.875017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563860a1ced84fa69a4d791bbeb15df4', 'request_id': 'req-580fd42a-2020-4675-92ee-30bba8da6928'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.880422 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563860a1ced84fa69a4d791bbeb15df4', 'request_id': 'req-580fd42a-2020-4675-92ee-30bba8da6928'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.886756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563860a1ced84fa69a4d791bbeb15df4', 'request_id': 'req-580fd42a-2020-4675-92ee-30bba8da6928'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.990243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] The token cache is being invalidate because project 563860a1ced84fa69a4d791bbeb15df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:03.990531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.991138 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:03.992652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1348/2687] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:03 2022] DELETE /identity/v3/projects/563860a1ced84fa69a4d791bbeb15df4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:39:03.996610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:03.998070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:04.010678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c9dea-a94e-4cd5-adfe-3d2dd7f81a52 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:04.067801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:04.068386 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.068663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.068940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] PATH_INFO: `/v3/users/31d057622662401d95949d1a7a53b68f` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.070301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d057622662401d95949d1a7a53b68f)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:04.072282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:04.268748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d057622662401d95949d1a7a53b68f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.276620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d057622662401d95949d1a7a53b68f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.306676 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:04.308182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:04.329127 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd42a-2020-4675-92ee-30bba8da6928 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:04.355352 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d057622662401d95949d1a7a53b68f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.362037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:04.362920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.363183 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.363456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] PATH_INFO: `/v3/projects/80c3f91364504d488919e2c4dbc6317f` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.368581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c3f91364504d488919e2c4dbc6317f)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:04.370561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:04.389690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d057622662401d95949d1a7a53b68f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.393847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d057622662401d95949d1a7a53b68f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.407407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1340/2688] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:03 2022] DELETE /identity/v3/users/31d057622662401d95949d1a7a53b68f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:04.546242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c3f91364504d488919e2c4dbc6317f', 'request_id': 'req-fad72c95-abcc-44ec-bba0-37f0d89eba22'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.552003 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c3f91364504d488919e2c4dbc6317f', 'request_id': 'req-fad72c95-abcc-44ec-bba0-37f0d89eba22'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.559038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c3f91364504d488919e2c4dbc6317f', 'request_id': 'req-fad72c95-abcc-44ec-bba0-37f0d89eba22'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.641325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] The token cache is being invalidate because project 80c3f91364504d488919e2c4dbc6317f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:04.641901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.642451 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-fad72c95-abcc-44ec-bba0-37f0d89eba22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:04.644175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1349/2689] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:04 2022] DELETE /identity/v3/projects/80c3f91364504d488919e2c4dbc6317f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:04.648427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:04.652421 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:04.758459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f32d5-45ea-47e3-852c-315429d7728f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:04.766975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9beac-b0a7-432f-9139-ac94fb32ecbe None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.768224 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9beac-b0a7-432f-9139-ac94fb32ecbe None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.768790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9beac-b0a7-432f-9139-ac94fb32ecbe None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.771202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1350/2690] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:39:04.778245 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.782804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.782804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.827476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] MFA Rules not processed for user `f2d4c142d5db423b868edceab8bdd019`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:04.829288 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:04.831098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.831433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:04.831715 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.832317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] PATH_INFO: `/v3/users/68462c5242384dfdb68e9efaf3f65e31` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.833846 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68462c5242384dfdb68e9efaf3f65e31)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:04.837314 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:04.899674 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1351/2691] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:39:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:04.924148 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:04.926724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:04.945370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9481eb-f30e-4720-a6c3-009f00650fd3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:04.949454 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:04.958550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:04.958550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:04.958550 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:04.985100 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:04.986645 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590d217-7c84-4599-bacd-a500a5fb3a82 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:04.996925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1352/2692] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:05.082925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b306-e0c4-4b8a-95ec-8b238fdbcff8 None None] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.083358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b306-e0c4-4b8a-95ec-8b238fdbcff8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.083638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b306-e0c4-4b8a-95ec-8b238fdbcff8 None None] PATH_INFO: `/` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.085340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68462c5242384dfdb68e9efaf3f65e31'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.085692 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1353/2693] 10.222.0.24 () {54 vars in 921 bytes} [Fri Mar 25 03:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 25 03:39:05.091541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.091831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.092362 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.092475 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68462c5242384dfdb68e9efaf3f65e31'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.111981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] MFA Rules not processed for user `ba728b1294014f94b7acab7ccf594ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:05.113376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.150761 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68462c5242384dfdb68e9efaf3f65e31'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.164132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68462c5242384dfdb68e9efaf3f65e31'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.164831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68462c5242384dfdb68e9efaf3f65e31'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.170744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1341/2694] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:04 2022] DELETE /identity/v3/users/68462c5242384dfdb68e9efaf3f65e31 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:05.171521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.172889 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.185374 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1354/2695] 10.222.0.24 () {58 vars in 1018 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:05.197122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.198690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.211117 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c69fd5-8207-4e08-9eff-ae062131320a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.242232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791447-2bac-4d1a-b590-51063ebdefbd admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.247896 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.248753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.249035 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.249300 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] PATH_INFO: `/v3/projects/c39caf47287048538d1d8ce05b9d3dab` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.250533 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39caf47287048538d1d8ce05b9d3dab)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.253902 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.265772 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.266434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.266712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.267012 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.333774 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.335257 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ba2f7-5014-4f35-b33a-0e4429f84b56 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.346456 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1355/2696] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:05.404179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39caf47287048538d1d8ce05b9d3dab', 'request_id': 'req-810a0eb1-12a6-4da8-b44f-355326bb0776'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.410918 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39caf47287048538d1d8ce05b9d3dab', 'request_id': 'req-810a0eb1-12a6-4da8-b44f-355326bb0776'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.508453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39caf47287048538d1d8ce05b9d3dab', 'request_id': 'req-810a0eb1-12a6-4da8-b44f-355326bb0776'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.519956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] The token cache is being invalidate because project c39caf47287048538d1d8ce05b9d3dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:05.520241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.520980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.523313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1342/2697] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:05 2022] DELETE /identity/v3/projects/c39caf47287048538d1d8ce05b9d3dab => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:05.529185 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead9-a814-4f9b-a19a-96a62901a570 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.529474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead9-a814-4f9b-a19a-96a62901a570 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.529803 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead9-a814-4f9b-a19a-96a62901a570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.548214 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-454aead9-a814-4f9b-a19a-96a62901a570 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:05.551383 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-454aead9-a814-4f9b-a19a-96a62901a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.580859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.585852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.614818 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1356/2698] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:05.621956 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.622243 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.622518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.640681 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:05.641940 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.651691 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1357/2699] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:05.655670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.656200 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0eb1-12a6-4da8-b44f-355326bb0776 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.661088 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.661814 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.662099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.662391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] PATH_INFO: `/v3/projects/44c923d7612b4b9aad98f2624a4ca76c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.664224 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c923d7612b4b9aad98f2624a4ca76c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.666240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.666378 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191a95-df83-4cb7-b4f1-3bdd52e441e3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.671164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.672167 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.672455 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.672771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.673481 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:39:05.673822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.675556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.687664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1358/2700] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:39:05.692102 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.702297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df22d1-4728-48e6-a666-080b0857cc9b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.707146 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.709258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.709258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.709258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.709258 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.711705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.771824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c923d7612b4b9aad98f2624a4ca76c', 'request_id': 'req-e20ab037-ddda-498e-9d8b-37a29d1319af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.777624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c923d7612b4b9aad98f2624a4ca76c', 'request_id': 'req-e20ab037-ddda-498e-9d8b-37a29d1319af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.793144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1359/2701] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:05.797469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.859724 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e961-ea54-4a05-b710-511edc97e107 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.864604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.865267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.865549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.865877 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.866600 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.868531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:05.874235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c923d7612b4b9aad98f2624a4ca76c', 'request_id': 'req-e20ab037-ddda-498e-9d8b-37a29d1319af'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.886129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] The token cache is being invalidate because project 44c923d7612b4b9aad98f2624a4ca76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:05.886414 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.887067 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e20ab037-ddda-498e-9d8b-37a29d1319af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:05.888609 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1343/2702] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:05 2022] DELETE /identity/v3/projects/44c923d7612b4b9aad98f2624a4ca76c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:05.893362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45a38-5b3c-41c7-bd06-da4c24760b3d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.893648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45a38-5b3c-41c7-bd06-da4c24760b3d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.893956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45a38-5b3c-41c7-bd06-da4c24760b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.912956 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-5da45a38-5b3c-41c7-bd06-da4c24760b3d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:05.914185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-5da45a38-5b3c-41c7-bd06-da4c24760b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.921946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1344/2703] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:05.930413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.930701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.930974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.949808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:05.954210 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:05.961777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1345/2704] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:05.964391 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:05.981186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1472-c8e9-4e81-8caa-e46e4da8bfaa None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:05.986900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:05.987597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:05.987877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:05.988153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:05.988980 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:39:05.989175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:05.990837 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.004689 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1346/2705] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:39:06.009313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.020326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1360/2706] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:05 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:39:06.027425 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077dcf-c748-4882-ab0c-f7ccf102ca71 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.032734 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.034606 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:06.041832 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.043398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.043944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.044389 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.045238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.047398 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.050017 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd817-1d3e-4edc-8102-3fe4878e5e5a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.056135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.057280 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.067684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.067684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.067684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.067684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.080636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1361/2707] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:39:06.085413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.096253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0433-0af0-40ac-aafc-3a3b88396056 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.101767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.101973 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.102256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.102670 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.103411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.105002 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.115191 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1362/2708] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:39:06.119727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.136788 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2abb-1482-40ab-8d86-4f74691f2064 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.142525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.143810 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.144267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.144723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] PATH_INFO: `/v3/projects/9987ebe638c34e0d9e74a2da722ae257/users/4a73072ee3804837ad47189353f4eb30/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.158677 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1347/2709] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:39:06.162080 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9987ebe638c34e0d9e74a2da722ae257, user_id=4a73072ee3804837ad47189353f4eb30, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.162778 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.165453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651de1d-cba7-4d45-bcf7-a8b253ff1611 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.225676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6d927-d119-4eac-b9a6-2ac8729a82ef admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.230305 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.230967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.231249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.231522 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.232217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.234156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.243142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1363/2710] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:06 2022] PUT /identity/v3/projects/9987ebe638c34e0d9e74a2da722ae257/users/4a73072ee3804837ad47189353f4eb30/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:39:06.254648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.255040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.255268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.282415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] MFA Rules not processed for user `4a73072ee3804837ad47189353f4eb30`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:06.283611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:06.325285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1348/2711] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:06.329946 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.340477 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f65c7b-3c03-48ce-b80b-a7b1ca837554 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.364833 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1364/2712] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:06.369711 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.403110 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.403766 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.404051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.404326 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.405058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.406670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.420504 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1349/2713] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:39:06.421498 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.432230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51dc2d-3611-48db-bc8a-bf615b413581 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.437375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.438072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.438350 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.438622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.439329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.441086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.445348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb9773-19f1-4bdf-90cc-b8b8308873d3 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.450414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.451177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.451469 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.451783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.452520 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.452964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1350/2714] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:39:06.454542 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.457130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.468808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599cff-b942-4708-a64c-2ce073af189e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.474466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.475375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.475664 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.475965 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] PATH_INFO: `/v3/projects/fea34503bf404bfab07e36e39adb75b2/users/361ff9075db6444a8989475e65f08aa4/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.490550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea34503bf404bfab07e36e39adb75b2, user_id=361ff9075db6444a8989475e65f08aa4, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.493847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7082b61-e224-46c9-b96d-421435aac620 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.573501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1365/2715] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:06.583673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.606884 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1351/2716] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:06 2022] PUT /identity/v3/projects/fea34503bf404bfab07e36e39adb75b2/users/361ff9075db6444a8989475e65f08aa4/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:39:06.618339 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.618644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.618944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.644943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] MFA Rules not processed for user `361ff9075db6444a8989475e65f08aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:06.647230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db76812-29bc-404d-8584-eba85236c8e9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.647765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:06.700275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.700869 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.701170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.701466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.702158 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.704078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.709804 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1352/2717] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:06.720390 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.721838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:06.797827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f242e9-8dba-4d6e-8db4-29bb75ed9a99 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.801959 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5e6d8163f1d4451af656c267e6b32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.802595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.802880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.803157 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.812086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.813676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.822419 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1353/2718] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:06.867623 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1366/2719] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:06 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:06.872156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.884023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad3b3-84fc-4b1a-a64d-aa6565c4c3ff service glance] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.888826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.889508 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.892258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.892550 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.893282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.894917 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:06.905448 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1354/2720] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:06.923805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:06.934368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc0a7-6e7a-4426-a2bf-5e430befa5ee admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:06.939038 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:06.939963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:06.940242 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:06.940521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] PATH_INFO: `/v3/projects/02123d231fdd4a6fb56cdd0cef95e352/users/97ea594244d14b95936cf28594a02d56/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:06.955627 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02123d231fdd4a6fb56cdd0cef95e352, user_id=97ea594244d14b95936cf28594a02d56, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:06.958850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:07.105776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1367/2721] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:06 2022] PUT /identity/v3/projects/02123d231fdd4a6fb56cdd0cef95e352/users/97ea594244d14b95936cf28594a02d56/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:07.110266 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:07.120216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d59-1bab-4d71-893e-50ce92ad31c6 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:07.183605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:07.184270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:07.184558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:07.184828 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:07.185547 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:07.187274 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab4fe-2ee0-4b0f-a993-35f3890a6737 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:07.198180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1355/2722] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:07.202655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:07.215531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b0b3-1e9d-4076-a504-12e0c39151d4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:07.220812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:07.221723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:07.222008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:07.222279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] PATH_INFO: `/v3/projects/02123d231fdd4a6fb56cdd0cef95e352/users/97ea594244d14b95936cf28594a02d56/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:07.224353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02123d231fdd4a6fb56cdd0cef95e352, user_id=97ea594244d14b95936cf28594a02d56, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:07.227639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:07.239371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1368/2723] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:07 2022] PUT /identity/v3/projects/02123d231fdd4a6fb56cdd0cef95e352/users/97ea594244d14b95936cf28594a02d56/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:07.251973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:07.252270 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:07.252552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:07.281407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] MFA Rules not processed for user `97ea594244d14b95936cf28594a02d56`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:07.282750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:07.355975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1356/2724] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:07.528910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:07.530715 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:07.597041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fe367-762d-447a-96b7-11b03077d2b7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:07.601463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:07.602159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:07.602434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:07.602705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:07.614075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:07.615926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a334f-0e74-4aff-a61a-b1170168ec4c service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:07.628128 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1369/2725] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:08.898464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:08.971711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf9df4-ac36-4b11-9eef-e893a760f4d6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:08.980915 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:08.982304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:08.982784 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:08.983273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] PATH_INFO: `/v3/users/4a73072ee3804837ad47189353f4eb30` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:08.984593 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a73072ee3804837ad47189353f4eb30)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:08.986624 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:09.159061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a73072ee3804837ad47189353f4eb30'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:09.166131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a73072ee3804837ad47189353f4eb30'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:09.241914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a73072ee3804837ad47189353f4eb30'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:09.254368 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a73072ee3804837ad47189353f4eb30'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:09.255026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a73072ee3804837ad47189353f4eb30'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:09.260926 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1357/2726] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:08 2022] DELETE /identity/v3/users/4a73072ee3804837ad47189353f4eb30 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:09.265490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:09.266027 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:09.266144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:09.287737 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:09.289498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:09.347760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1370/2727] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:09.357922 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:09.359328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:09.421885 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9e341-d77e-430f-9b6a-2cb46a70a8e8 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:09.425455 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:09.426134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:09.426409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:09.426678 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:09.436185 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:09.437638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:09.447418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1358/2728] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:09.958429 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:09.962823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:09.975981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bc60-e3d5-419d-8f87-0e8fc492893c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:09.981053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:09.981963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:09.982240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:09.982518 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] PATH_INFO: `/v3/projects/9987ebe638c34e0d9e74a2da722ae257` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:09.983806 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9987ebe638c34e0d9e74a2da722ae257)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:09.985945 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:10.094438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9987ebe638c34e0d9e74a2da722ae257', 'request_id': 'req-91226372-d02e-46d6-be0f-3d1decf11b84'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.099712 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9987ebe638c34e0d9e74a2da722ae257', 'request_id': 'req-91226372-d02e-46d6-be0f-3d1decf11b84'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.105883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9987ebe638c34e0d9e74a2da722ae257', 'request_id': 'req-91226372-d02e-46d6-be0f-3d1decf11b84'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.164999 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] The token cache is being invalidate because project 9987ebe638c34e0d9e74a2da722ae257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:10.165307 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.165942 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.167490 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1371/2729] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:09 2022] DELETE /identity/v3/projects/9987ebe638c34e0d9e74a2da722ae257 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:10.171551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:10.182066 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63565ee-8982-4f47-8a47-60dce95c9b25 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:10.238306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:10.238998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:10.239280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:10.239553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] PATH_INFO: `/v3/users/97ea594244d14b95936cf28594a02d56` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:10.240760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ea594244d14b95936cf28594a02d56)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:10.243217 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:10.429279 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ea594244d14b95936cf28594a02d56'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.442257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ea594244d14b95936cf28594a02d56'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.505113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ea594244d14b95936cf28594a02d56'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.519334 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ea594244d14b95936cf28594a02d56'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.520153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2b012e1d-431a-4161-8a5f-797669433256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ea594244d14b95936cf28594a02d56'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:10.527175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1359/2730] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:10 2022] DELETE /identity/v3/users/97ea594244d14b95936cf28594a02d56 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:10.901426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:10.902953 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:10.919515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226372-d02e-46d6-be0f-3d1decf11b84 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:10.987345 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:10.988215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:10.988500 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:10.988781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] PATH_INFO: `/v3/projects/02123d231fdd4a6fb56cdd0cef95e352` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:10.990010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02123d231fdd4a6fb56cdd0cef95e352)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:10.991975 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.095246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02123d231fdd4a6fb56cdd0cef95e352', 'request_id': 'req-d4517ebf-acd9-4c3c-83bb-808963bf0803'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:11.100574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02123d231fdd4a6fb56cdd0cef95e352', 'request_id': 'req-d4517ebf-acd9-4c3c-83bb-808963bf0803'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:11.106648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02123d231fdd4a6fb56cdd0cef95e352', 'request_id': 'req-d4517ebf-acd9-4c3c-83bb-808963bf0803'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:11.174557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] The token cache is being invalidate because project 02123d231fdd4a6fb56cdd0cef95e352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:11.174861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:11.175605 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-d4517ebf-acd9-4c3c-83bb-808963bf0803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:11.177220 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1372/2731] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:10 2022] DELETE /identity/v3/projects/02123d231fdd4a6fb56cdd0cef95e352 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:11.182204 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.182699 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.185939 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.200437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:11.201629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:11.261940 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1360/2732] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:11.270040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.270343 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.270620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.290394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:11.291514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:11.299558 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1373/2733] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:11.304138 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.313877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65efb0b-0ad7-4965-9265-c3aabd9cd0f6 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.318464 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.319114 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.319396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.319670 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.320880 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:39:11.321186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.322841 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.334991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1361/2734] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:39:11.340016 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.349338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a6b9-e4a5-4cb7-9ea3-b6bc63fcd738 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.354044 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.354683 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.354965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.355238 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.355912 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.357845 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.466216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1374/2735] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:11 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:11.470934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.482742 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31abb48-8b8c-4e47-a6eb-89470de9ca52 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.544407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.545079 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.545375 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.545638 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.546385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.548453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.659518 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1362/2736] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:11 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:11.663434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.673786 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c0e3-5935-4556-8587-18c33ba93abc admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.678272 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.678914 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.679197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.679960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.680723 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.686241 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.694466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1375/2737] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:11.697614 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.707732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b910-21bf-4d07-a004-42d85f14bd58 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.712825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.714753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.714753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.714753 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.715017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.716401 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215ff2-aea6-45e3-b7f2-becb4945626e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.726471 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1363/2738] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:11.730919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:11.741438 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e422e-fa70-4e80-a51c-71b8054c4aff admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:11.746318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:11.747199 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.747482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.747755 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] PATH_INFO: `/v3/projects/48409878140c478e8b17224a4dfd8a05/users/da222ac9c137402c83d8c547d25c6b32/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.762309 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48409878140c478e8b17224a4dfd8a05, user_id=da222ac9c137402c83d8c547d25c6b32, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:11.764998 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:11.893549 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1376/2739] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:11 2022] PUT /identity/v3/projects/48409878140c478e8b17224a4dfd8a05/users/da222ac9c137402c83d8c547d25c6b32/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:11.904426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:11.904759 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:11.905034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:11.933615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] MFA Rules not processed for user `da222ac9c137402c83d8c547d25c6b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:11.934856 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:11.999489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1364/2740] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:12.003944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.108673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7ef3d-24ad-491f-a516-05bbf0347f54 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.125356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.126290 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.126835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.127428 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.128104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.130265 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.213333 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1377/2741] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:12 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:12.217701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.229340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81125f68-52ce-49ad-b67a-61b184298bb3 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.285435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.286236 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.286589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.286869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.287592 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.290285 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.377240 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1365/2742] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:12 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:39:12.381260 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.391776 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee5c7-b005-49e9-a3ae-eb8453246b1c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.396435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.397326 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.397448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.397702 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.398859 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.400467 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.410664 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1378/2743] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:12.415488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.425098 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652344bb-4534-470f-af6f-2d541ce776e0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.429637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.430573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.430857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.431129 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] PATH_INFO: `/v3/projects/8db80678a3eb47d4af54977a0643cc9b/users/eb1e97a6c32645d9acea3d262b1547f9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.445103 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db80678a3eb47d4af54977a0643cc9b, user_id=eb1e97a6c32645d9acea3d262b1547f9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.447791 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.516359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1366/2744] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:12 2022] PUT /identity/v3/projects/8db80678a3eb47d4af54977a0643cc9b/users/eb1e97a6c32645d9acea3d262b1547f9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:12.520122 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.530750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e670e-0ece-4ba3-8c9a-8c6d8834a5a0 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.587339 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.588008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.588288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.588561 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.589271 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.590920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59afe10-2afe-44ce-85bb-203c50f077f6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.600815 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1379/2745] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:12.605049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.615862 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d86a-91d5-421e-83dd-dd60b2ff81a1 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.620571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.621452 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.621776 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.622055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] PATH_INFO: `/v3/projects/8db80678a3eb47d4af54977a0643cc9b/users/eb1e97a6c32645d9acea3d262b1547f9/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.624021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db80678a3eb47d4af54977a0643cc9b, user_id=eb1e97a6c32645d9acea3d262b1547f9, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.626756 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.637667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1367/2746] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:12 2022] PUT /identity/v3/projects/8db80678a3eb47d4af54977a0643cc9b/users/eb1e97a6c32645d9acea3d262b1547f9/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:12.649915 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.650239 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.650534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.676228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] MFA Rules not processed for user `eb1e97a6c32645d9acea3d262b1547f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:12.677359 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:12.745109 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1380/2747] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:12.759273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:12.760993 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:12.817418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522614e-c527-4657-a42a-5bfe5dee8c3f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:12.821757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:12.822404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:12.822688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:12.822966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:12.831863 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:12.833306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed9ea3-6983-41cd-936e-07353a5580f4 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:12.843175 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1368/2748] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:39:13.406881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:13.469504 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82b2f-3591-43d8-8744-6e0b9d65107a None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:13.474005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:13.474871 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:13.475153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:13.476144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] PATH_INFO: `/v3/users/da222ac9c137402c83d8c547d25c6b32` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:13.476621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da222ac9c137402c83d8c547d25c6b32)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:13.478690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:13.644479 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da222ac9c137402c83d8c547d25c6b32'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:13.651797 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da222ac9c137402c83d8c547d25c6b32'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:13.663089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da222ac9c137402c83d8c547d25c6b32'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:13.663753 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da222ac9c137402c83d8c547d25c6b32'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:13.720009 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da222ac9c137402c83d8c547d25c6b32'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:13.726322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1381/2749] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:13 2022] DELETE /identity/v3/users/da222ac9c137402c83d8c547d25c6b32 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:13.731237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:13.731770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:13.731770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:13.751159 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:13.752358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:13.810091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1369/2750] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:13.820739 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:13.822263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:13.878342 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19a4b-db4e-4c73-9297-0f2afca7cb4c admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:13.882162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:13.887068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:13.887356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:13.887640 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:13.896703 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:13.898652 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:13.907901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1382/2751] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:14.323733 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:14.325133 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:14.336838 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf919a-0a4d-4c63-9b8a-7ce7ddc55a1e None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:14.341395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:14.342526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:14.342798 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:14.343061 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] PATH_INFO: `/v3/projects/48409878140c478e8b17224a4dfd8a05` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:14.344233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48409878140c478e8b17224a4dfd8a05)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:14.346309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:14.469299 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48409878140c478e8b17224a4dfd8a05', 'request_id': 'req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.475038 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48409878140c478e8b17224a4dfd8a05', 'request_id': 'req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.548381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48409878140c478e8b17224a4dfd8a05', 'request_id': 'req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.562544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] The token cache is being invalidate because project 48409878140c478e8b17224a4dfd8a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:14.563255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.564101 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.565647 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1370/2752] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:14 2022] DELETE /identity/v3/projects/48409878140c478e8b17224a4dfd8a05 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:14.571466 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:14.589883 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0f1c0-fa36-48d1-87cd-f0f7c5a08dde service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:14.639482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:14.640346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:14.640626 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:14.640901 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] PATH_INFO: `/v3/users/eb1e97a6c32645d9acea3d262b1547f9` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:14.642093 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1e97a6c32645d9acea3d262b1547f9)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:14.644054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:14.856197 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1e97a6c32645d9acea3d262b1547f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.868192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1e97a6c32645d9acea3d262b1547f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.874553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1e97a6c32645d9acea3d262b1547f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.875226 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1e97a6c32645d9acea3d262b1547f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.982528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1e97a6c32645d9acea3d262b1547f9'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:14.988964 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1383/2753] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:14 2022] DELETE /identity/v3/users/eb1e97a6c32645d9acea3d262b1547f9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:15.373181 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:15.374649 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:15.388309 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc456f-96a7-4c3b-b5ea-d9a95a44986e admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:15.452282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:15.453355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:15.453796 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:15.454109 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] PATH_INFO: `/v3/projects/8db80678a3eb47d4af54977a0643cc9b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:15.455745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db80678a3eb47d4af54977a0643cc9b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:15.457955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:15.569829 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db80678a3eb47d4af54977a0643cc9b', 'request_id': 'req-521e0e1b-3be8-412b-903d-5422fa2d814f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:15.576020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db80678a3eb47d4af54977a0643cc9b', 'request_id': 'req-521e0e1b-3be8-412b-903d-5422fa2d814f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:15.647564 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db80678a3eb47d4af54977a0643cc9b', 'request_id': 'req-521e0e1b-3be8-412b-903d-5422fa2d814f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:15.660059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] The token cache is being invalidate because project 8db80678a3eb47d4af54977a0643cc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:15.660344 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:15.660998 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-521e0e1b-3be8-412b-903d-5422fa2d814f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:15.662613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1371/2754] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:15 2022] DELETE /identity/v3/projects/8db80678a3eb47d4af54977a0643cc9b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:28.428525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:28.430025 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:28.442556 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6f41a-5419-4429-a06a-175300d0328e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:28.496447 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:28.497301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:28.497586 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:28.497902 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] PATH_INFO: `/v3/users/361ff9075db6444a8989475e65f08aa4` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:28.499073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361ff9075db6444a8989475e65f08aa4)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:28.501053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:28.700194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361ff9075db6444a8989475e65f08aa4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:28.707001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361ff9075db6444a8989475e65f08aa4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:28.718615 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361ff9075db6444a8989475e65f08aa4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:28.719295 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361ff9075db6444a8989475e65f08aa4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:28.812667 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361ff9075db6444a8989475e65f08aa4'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:28.818903 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1384/2755] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:28 2022] DELETE /identity/v3/users/361ff9075db6444a8989475e65f08aa4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:28.823960 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:28.824472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:28.824602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:28.841487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:28.842967 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:28.900134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1372/2756] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:28.909773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:28.911202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:28.967960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f30170-9bbc-47e0-9414-59c8095db017 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:28.975008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:28.975008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:28.975008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:28.975008 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:28.985346 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:28.986843 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a348e-2f06-4202-9897-7e001d9aa32f service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:28.996967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1385/2757] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:29.406879 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:29.408376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:29.421153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de6a0-ad42-475e-8a05-cf4414c6007c None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:29.425750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:29.426602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:29.426881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:29.427151 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] PATH_INFO: `/v3/projects/fea34503bf404bfab07e36e39adb75b2` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:29.428450 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea34503bf404bfab07e36e39adb75b2)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:29.430402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:29.656748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea34503bf404bfab07e36e39adb75b2', 'request_id': 'req-fc849930-da9c-48c9-8243-c45b8d235c38'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:29.656748 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea34503bf404bfab07e36e39adb75b2', 'request_id': 'req-fc849930-da9c-48c9-8243-c45b8d235c38'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:29.767329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea34503bf404bfab07e36e39adb75b2', 'request_id': 'req-fc849930-da9c-48c9-8243-c45b8d235c38'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:29.779092 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] The token cache is being invalidate because project fea34503bf404bfab07e36e39adb75b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:29.779379 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:29.779994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-fc849930-da9c-48c9-8243-c45b8d235c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:29.781526 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1373/2758] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:29 2022] DELETE /identity/v3/projects/fea34503bf404bfab07e36e39adb75b2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:29.786379 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:29.786867 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:29.786974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:29.804356 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:29.805543 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:29.862895 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1386/2759] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:29.871144 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:29.871622 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:29.871729 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:29.889990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:29.891179 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:29.898881 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1374/2760] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:29.903608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:29.912949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06655e-2c48-4f55-a653-2ba9612c184b None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:29.917426 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:29.918101 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:29.918382 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:29.918655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:29.919365 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:39:29.919668 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:29.921273 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:29.932355 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1387/2761] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:39:29.936410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:29.945281 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6e7e-bcef-440c-8511-a56bfbe662b9 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:29.950503 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:29.951132 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:29.951412 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:29.951683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:29.952365 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:29.954329 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.042039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1375/2762] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:29 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:39:30.047175 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:30.057316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfad92-1610-4e12-a57e-86d06422b9f9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:30.113222 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:30.113909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.114219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.114516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.115279 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:30.117186 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.228403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1388/2763] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:30 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:30.232558 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:30.242658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d9d69-29e9-408f-841a-8d7f0b259a4d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:30.248371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:30.249049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.249332 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.249637 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.250376 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:30.251983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.265025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1376/2764] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:30.268829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:30.279056 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e885fb-af75-4e33-b34a-eca7b89d8a7e admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:30.284584 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:30.285582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.286130 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.286601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.287861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:30.289993 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f825fca-763e-45ad-927d-31ac2c514120 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.299890 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1389/2765] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:30.303929 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:30.314496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934ed-b48e-4462-8c70-916f8d1c3dc9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:30.318973 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:30.319949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.320255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.320527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] PATH_INFO: `/v3/projects/8121c3f938fb46cd989acc7e8fc8c6fd/users/4a4dd4728fea4631b313ae3b5cade579/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.335656 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8121c3f938fb46cd989acc7e8fc8c6fd, user_id=4a4dd4728fea4631b313ae3b5cade579, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:30.338435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.395616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1377/2766] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:30 2022] PUT /identity/v3/projects/8121c3f938fb46cd989acc7e8fc8c6fd/users/4a4dd4728fea4631b313ae3b5cade579/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:30.407320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.407612 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.407891 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.434781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] MFA Rules not processed for user `4a4dd4728fea4631b313ae3b5cade579`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:30.441180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:30.501503 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1390/2767] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:30.512741 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:30.514422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:30.571322 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411507-7152-4fce-a5c1-dd3253bb93ec admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:30.575090 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f0592-9287-452d-9432-1de155db796d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:30.575728 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0592-9287-452d-9432-1de155db796d service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:30.576008 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0592-9287-452d-9432-1de155db796d service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:30.576286 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0592-9287-452d-9432-1de155db796d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:30.584859 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f0592-9287-452d-9432-1de155db796d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:30.586392 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f0592-9287-452d-9432-1de155db796d service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:30.595682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1378/2768] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:40.626498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:40.627925 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:40.691284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92ba1-14f7-4fe5-8d02-a2575b6ac884 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:40.695754 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:40.696607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:40.696882 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:40.697151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] PATH_INFO: `/v3/users/3b8bf22e5bee4a4684a86d90521fd8eb` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:40.698352 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8bf22e5bee4a4684a86d90521fd8eb)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:40.700322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:40.923133 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8bf22e5bee4a4684a86d90521fd8eb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:40.929680 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8bf22e5bee4a4684a86d90521fd8eb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:40.941202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8bf22e5bee4a4684a86d90521fd8eb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:40.941947 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8bf22e5bee4a4684a86d90521fd8eb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:41.024829 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8bf22e5bee4a4684a86d90521fd8eb'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:41.031885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1391/2769] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:40 2022] DELETE /identity/v3/users/3b8bf22e5bee4a4684a86d90521fd8eb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:41.036515 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:41.036987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:41.037086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:41.053996 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:41.055719 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:41.121469 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1379/2770] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:41.131190 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:41.132736 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:41.191153 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a1be-389a-4610-847f-9c269f96de39 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:41.194822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:41.195465 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:41.195747 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:41.196023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:41.205533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:41.207267 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:41.217202 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1392/2771] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:41.617581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:41.622842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:41.632058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f891b-9905-4cd4-9f67-3bbdc1b186ac None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:41.638551 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:41.639750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:41.640002 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:41.640280 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] PATH_INFO: `/v3/projects/fabe60256f834ffb9cad941af89a7f2b` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:41.641605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabe60256f834ffb9cad941af89a7f2b)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:41.643575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:41.953493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabe60256f834ffb9cad941af89a7f2b', 'request_id': 'req-10180ebe-442f-4774-b11c-2e723ee5f60d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:41.959076 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabe60256f834ffb9cad941af89a7f2b', 'request_id': 'req-10180ebe-442f-4774-b11c-2e723ee5f60d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.047025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabe60256f834ffb9cad941af89a7f2b', 'request_id': 'req-10180ebe-442f-4774-b11c-2e723ee5f60d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.058191 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] The token cache is being invalidate because project fabe60256f834ffb9cad941af89a7f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:42.058472 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.059086 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.060598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1380/2772] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:41 2022] DELETE /identity/v3/projects/fabe60256f834ffb9cad941af89a7f2b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:42.064525 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:42.074184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9604c-3d0f-409b-afb9-cd5a88b17587 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:42.129372 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:42.130312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:42.130591 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:42.130860 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] PATH_INFO: `/v3/users/ed5b348e30d140fabf8fe4e2b555e55b` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:42.132077 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5b348e30d140fabf8fe4e2b555e55b)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:42.134164 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:42.311004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5b348e30d140fabf8fe4e2b555e55b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.317778 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5b348e30d140fabf8fe4e2b555e55b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.328920 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5b348e30d140fabf8fe4e2b555e55b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.329601 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5b348e30d140fabf8fe4e2b555e55b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.383949 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-762170e7-de0d-49bd-b01c-5d845ad31dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5b348e30d140fabf8fe4e2b555e55b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.390340 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1393/2773] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:39:42 2022] DELETE /identity/v3/users/ed5b348e30d140fabf8fe4e2b555e55b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:42.762763 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:42.764786 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:42.784934 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10180ebe-442f-4774-b11c-2e723ee5f60d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:42.841561 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:42.842698 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:42.842972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:42.843234 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] PATH_INFO: `/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:42.844384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31bc55e4ec64dafbbb52d9412ebf0e9)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:42.846304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:42.978648 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31bc55e4ec64dafbbb52d9412ebf0e9', 'request_id': 'req-559ca0e2-2f1a-4383-9420-62b6e19851a1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:42.983931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31bc55e4ec64dafbbb52d9412ebf0e9', 'request_id': 'req-559ca0e2-2f1a-4383-9420-62b6e19851a1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:43.056255 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31bc55e4ec64dafbbb52d9412ebf0e9', 'request_id': 'req-559ca0e2-2f1a-4383-9420-62b6e19851a1'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:43.068025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] The token cache is being invalidate because project a31bc55e4ec64dafbbb52d9412ebf0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:39:43.068306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:43.068937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-559ca0e2-2f1a-4383-9420-62b6e19851a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:39:43.070442 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1381/2774] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:39:42 2022] DELETE /identity/v3/projects/a31bc55e4ec64dafbbb52d9412ebf0e9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:43.075246 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.075689 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.075804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.093850 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:43.094997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:43.151535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1394/2775] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:43.160523 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.160802 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.161071 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.181256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:43.182701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:43.191382 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1382/2776] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:43.195761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.204974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c58e76-70e2-4b09-bad6-e82e3bb9aaa2 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.215537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.215537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.215537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.215537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.216049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:39:43.216049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.216049 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.225769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1395/2777] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:39:43.229989 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.239975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407f4f3-a3b7-4994-8a48-977ad7ac0c0d None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.244744 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.245385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.245682 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.245962 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.246634 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.249183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.346069 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1383/2778] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:43 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:43.350163 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.360727 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d33dd-8318-42e8-8cf7-31a9d1dde596 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.414701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.415350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.415628 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.415896 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.416576 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.418555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.490160 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1396/2779] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:43 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:39:43.494161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.504866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4335797-6304-468f-9afe-7edb8ef1d2c7 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.509559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.510238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.510582 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.510887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.511601 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.513203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.523104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1384/2780] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:43.526977 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.537325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0488f7-db1e-479a-8efe-96f154997497 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.541985 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.545452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.545452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.545452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.545452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.546219 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a160b8-c009-4e82-ab72-57ed0570015c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.555879 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1397/2781] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:43.559732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.569186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b50a7-c176-4020-9d37-8ba0773fd3bf admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.573631 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.574499 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.574774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.575039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] PATH_INFO: `/v3/projects/7b7a3ca38ce248f7bb610139aa59bef6/users/348f9d8733254c45bd1e10569922311a/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.589404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7a3ca38ce248f7bb610139aa59bef6, user_id=348f9d8733254c45bd1e10569922311a, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.592857 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.683978 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1385/2782] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:43 2022] PUT /identity/v3/projects/7b7a3ca38ce248f7bb610139aa59bef6/users/348f9d8733254c45bd1e10569922311a/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:43.688917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58076e-d669-4451-87fc-52ab798b1a39 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.689209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58076e-d669-4451-87fc-52ab798b1a39 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.689487 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58076e-d669-4451-87fc-52ab798b1a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.707491 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-4d58076e-d669-4451-87fc-52ab798b1a39 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:43.708679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4d58076e-d669-4451-87fc-52ab798b1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:43.765051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1398/2783] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:43.774750 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:43.776493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:43.832711 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2919cb-2130-4c3b-8110-e3daeba3a0cc admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:43.836244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:43.836869 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:43.837146 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:43.837416 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:43.846928 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:43.848340 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:43.858096 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1386/2784] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:45.220204 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.220751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.220751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.248440 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] MFA Rules not processed for user `348f9d8733254c45bd1e10569922311a`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:45.249639 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:45.317104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1399/2785] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:39:45.321493 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.333028 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8233f-c693-4e8f-bfc1-ca2dfd2ece58 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.337738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.338524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.338963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.339207 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.340215 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.343017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.455991 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1387/2786] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:39:45 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:45.460347 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.472541 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8dd1c-3b0e-4eae-8f1f-c025ff94fc69 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.528392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.529962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.530244 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.530513 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.531221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.533166 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.630630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1400/2787] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:39:45 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:39:45.634361 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.645032 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635ce3-b4fb-4e16-8062-3f9c941ce1e9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.649687 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.650404 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.650686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.650955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.651667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.653256 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.664025 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1388/2788] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:45.668196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.678285 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dfa8-d8d0-41c9-86fe-2c3455f5bc03 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.682899 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.683765 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.684047 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.684320 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] PATH_INFO: `/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5/users/ac0379ec2c2c4eb6ac6b1351364095db/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.699065 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05588cf0e4bf4545be71fc8abe3f08a5, user_id=ac0379ec2c2c4eb6ac6b1351364095db, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.702622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.818582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1401/2789] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:45 2022] PUT /identity/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5/users/ac0379ec2c2c4eb6ac6b1351364095db/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:45.822574 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.832931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db39a-2d6d-43a3-8cb9-04734ed06370 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.886016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.886598 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.886877 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.887238 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.887975 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.890202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edb671-410d-4f89-9e47-49c32f3b2310 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.899635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1389/2790] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:39:45.903825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:45.914196 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc158-7e7e-48e1-b1d1-3e33cd6f746f admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:45.918958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:45.919900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:45.920177 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:45.920446 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] PATH_INFO: `/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5/users/ac0379ec2c2c4eb6ac6b1351364095db/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:45.922537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05588cf0e4bf4545be71fc8abe3f08a5, user_id=ac0379ec2c2c4eb6ac6b1351364095db, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:45.925192 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:45.936051 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1402/2791] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:39:45 2022] PUT /identity/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5/users/ac0379ec2c2c4eb6ac6b1351364095db/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:39:47.203351 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:47.203910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:47.203910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:47.232468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] MFA Rules not processed for user `ac0379ec2c2c4eb6ac6b1351364095db`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:39:47.233690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:47.307811 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1390/2792] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:39:47.319415 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:47.324607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:39:47.377571 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73fbb-9cd3-4314-8854-bb6649ad01d7 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:47.381157 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:47.381823 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:47.382104 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:47.382376 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:47.444954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:47.444954 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:47.454769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1403/2793] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:39:49.267400 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:39:49.276764 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c85d1-06e6-46e5-9ff1-9f147bbd07b7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:39:49.280426 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:39:49.281051 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:39:49.281359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:39:49.281632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:39:49.290443 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:39:49.295269 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:39:49.302042 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1391/2794] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:04.926931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:04.992580 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b6ac9-6eb9-48ae-8277-7db556c7fb8e service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:04.997078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:04.998074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:04.998351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:04.998621 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] PATH_INFO: `/v3/users/348f9d8733254c45bd1e10569922311a` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:04.999796 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348f9d8733254c45bd1e10569922311a)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:05.001756 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:05.186121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348f9d8733254c45bd1e10569922311a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.193516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348f9d8733254c45bd1e10569922311a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.205516 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348f9d8733254c45bd1e10569922311a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.206173 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348f9d8733254c45bd1e10569922311a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.284402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348f9d8733254c45bd1e10569922311a'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.290939 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1404/2795] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:04 2022] DELETE /identity/v3/users/348f9d8733254c45bd1e10569922311a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:05.535701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:05.547887 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eaefe-30ca-49d4-9550-5f4f9d42417b service cinder] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:05.625346 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:05.626241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:05.626528 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:05.626851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] PATH_INFO: `/v3/projects/7b7a3ca38ce248f7bb610139aa59bef6` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:05.628049 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7a3ca38ce248f7bb610139aa59bef6)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:05.630726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:05.721242 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7a3ca38ce248f7bb610139aa59bef6', 'request_id': 'req-60dc5385-87e6-48d1-9667-2b8de0414c08'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.726801 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7a3ca38ce248f7bb610139aa59bef6', 'request_id': 'req-60dc5385-87e6-48d1-9667-2b8de0414c08'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.838620 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7a3ca38ce248f7bb610139aa59bef6', 'request_id': 'req-60dc5385-87e6-48d1-9667-2b8de0414c08'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.850625 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] The token cache is being invalidate because project 7b7a3ca38ce248f7bb610139aa59bef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:05.850851 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.851497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:05.853015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1392/2796] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:05 2022] DELETE /identity/v3/projects/7b7a3ca38ce248f7bb610139aa59bef6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:05.856974 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:05.858453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:05.871840 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03435-1ef9-4157-bd89-cb48d1647709 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:05.930462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:05.932074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:05.932526 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:05.932955 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] PATH_INFO: `/v3/users/ac0379ec2c2c4eb6ac6b1351364095db` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:05.934351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0379ec2c2c4eb6ac6b1351364095db)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:05.936575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:06.191351 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0379ec2c2c4eb6ac6b1351364095db'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.198161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0379ec2c2c4eb6ac6b1351364095db'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.209453 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0379ec2c2c4eb6ac6b1351364095db'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.210200 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0379ec2c2c4eb6ac6b1351364095db'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.272638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-521b04c3-4fee-47e0-a1a7-46834f339b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0379ec2c2c4eb6ac6b1351364095db'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.280037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1405/2797] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:05 2022] DELETE /identity/v3/users/ac0379ec2c2c4eb6ac6b1351364095db => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:06.546048 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:06.548805 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:06.563480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc5385-87e6-48d1-9667-2b8de0414c08 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:06.623463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:06.624241 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:06.624548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:06.624817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] PATH_INFO: `/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:06.626007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=05588cf0e4bf4545be71fc8abe3f08a5)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:06.628463 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:06.742695 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05588cf0e4bf4545be71fc8abe3f08a5', 'request_id': 'req-7d174cd7-ab9a-4675-908e-bb51db84adcb'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.748395 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05588cf0e4bf4545be71fc8abe3f08a5', 'request_id': 'req-7d174cd7-ab9a-4675-908e-bb51db84adcb'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.852435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05588cf0e4bf4545be71fc8abe3f08a5', 'request_id': 'req-7d174cd7-ab9a-4675-908e-bb51db84adcb'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.863906 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] The token cache is being invalidate because project 05588cf0e4bf4545be71fc8abe3f08a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:06.864188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.864826 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-7d174cd7-ab9a-4675-908e-bb51db84adcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:06.866381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1393/2798] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:06 2022] DELETE /identity/v3/projects/05588cf0e4bf4545be71fc8abe3f08a5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:06.872020 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:06.872392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:06.872769 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:06.890958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:06.892156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:06.948831 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1406/2799] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:06.957294 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:06.957578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:06.957897 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:06.976013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:06.977197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:06.985194 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1394/2800] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:06.989917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:06.999706 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acb17-3ed9-4452-a572-01191179e76e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.004884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.005528 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.005852 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.006125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.006836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:40:07.007135 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.008729 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.020024 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1407/2801] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 25 03:40:07.024167 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.033021 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616e97-b407-49d3-9ee8-0cb1a667f68a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.037770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.038432 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.038738 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.039006 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.039683 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.041567 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.128982 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1395/2802] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:40:07.132989 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.149221 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0348-28d9-4cb0-b131-6924ffe50343 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.195962 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.200781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.200781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.200781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.200781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.200781 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.295499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1408/2803] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:07.299671 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.310914 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd706-f0e5-4b51-88ce-26c04d7b3dd9 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.316319 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.316954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.317273 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.317543 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.318301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.319875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.329937 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1396/2804] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:07.333611 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.344296 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18123a-df0e-46d1-a71d-47d705a2d842 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.348983 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.349535 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.349958 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.350306 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.351031 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.352648 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2203a-ce67-4ac3-999a-f3a5897831a0 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.368316 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1409/2805] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:07.369164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.380958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5f3d-1032-41c9-b05a-212067f2f32f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.386164 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.387161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.387541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.387905 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] PATH_INFO: `/v3/projects/c38e0f0920cd4815bde061a866d48749/users/f564d6e4a7764dd794fb209e5ea129d7/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.391235 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126002-9485-4b3c-ab69-988708448406 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.391521 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126002-9485-4b3c-ab69-988708448406 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.391790 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126002-9485-4b3c-ab69-988708448406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.404676 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38e0f0920cd4815bde061a866d48749, user_id=f564d6e4a7764dd794fb209e5ea129d7, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.407538 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.411480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-23126002-9485-4b3c-ab69-988708448406 None None] MFA Rules not processed for user `384b83917c9a4766b0117de6e71942ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:07.413775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-23126002-9485-4b3c-ab69-988708448406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:07.467718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1410/2806] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 25 03:40:07.504249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1397/2807] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:07 2022] PUT /identity/v3/projects/c38e0f0920cd4815bde061a866d48749/users/f564d6e4a7764dd794fb209e5ea129d7/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:07.514464 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.516215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.516215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.543997 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] MFA Rules not processed for user `f564d6e4a7764dd794fb209e5ea129d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:07.545182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:07.609091 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1411/2808] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:07.613861 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.690893 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24560b-c0d0-48c6-90aa-f42de6e76007 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.696793 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.697446 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.697762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.698041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.698734 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.700707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.817370 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1398/2809] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:07.821401 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.832300 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cc4f1-cd4a-48ee-86e9-70ac121b3f88 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:07.887329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:07.887991 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:07.888266 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:07.888538 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:07.889225 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:07.891184 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:07.984522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1412/2810] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:40:07 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:07.988935 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:07.999230 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41674aaa-8f67-42dd-9d8e-83ea98677611 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:08.003995 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:08.004816 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.005106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.005491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.006260 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:08.007883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:08.019356 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1399/2811] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:40:08.023678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:08.040722 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70c190-c591-4bfa-9d2e-53d060bcbb98 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:08.042433 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:08.043390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.043773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.044121 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] PATH_INFO: `/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c/users/38ea5e83e8934d1a98d299e4814c5c4e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.063180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d9eb13b7704d7a9edb85fce56d064c, user_id=38ea5e83e8934d1a98d299e4814c5c4e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:08.067419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:08.190007 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1413/2812] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:08 2022] PUT /identity/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c/users/38ea5e83e8934d1a98d299e4814c5c4e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:08.194589 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:08.204489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc603be-a615-4144-b194-5d4fea5a41d3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:08.263358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:08.263358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.263358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.263358 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.263781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:08.263888 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ada1c-ff21-4f4f-8a0c-1570ab083a98 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:08.275199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1400/2813] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:08.278855 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:08.290115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a5629-4666-41cb-a18e-e7c54c9e21d6 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:08.295068 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:08.296203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.296750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.296750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] PATH_INFO: `/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c/users/38ea5e83e8934d1a98d299e4814c5c4e/roles/36a26de00c7141a09176dacfb7236db0` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.298791 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d9eb13b7704d7a9edb85fce56d064c, user_id=38ea5e83e8934d1a98d299e4814c5c4e, role_id=36a26de00c7141a09176dacfb7236db0)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:08.301921 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:08.312461 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1414/2814] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:08 2022] PUT /identity/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c/users/38ea5e83e8934d1a98d299e4814c5c4e/roles/36a26de00c7141a09176dacfb7236db0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:08.323847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.324135 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.324410 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.350485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] MFA Rules not processed for user `38ea5e83e8934d1a98d299e4814c5c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:08.351700 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:08.422840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1401/2815] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:08.433554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:08.435431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:08.492390 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63820b-c63a-4851-8d1e-e654bf945ec9 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:08.495960 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:08.496644 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:08.496930 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:08.497201 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:08.566995 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:08.568708 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798d13-a2a4-4a30-a11b-4f97b9470de8 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:08.578248 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1415/2816] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:13.469494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:13.470954 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:13.535963 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ddf4a-e6f2-4fcf-81e0-f696c84f87fb None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:13.540422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:13.541284 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:13.541565 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:13.541882 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] PATH_INFO: `/v3/users/4a4dd4728fea4631b313ae3b5cade579` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:13.543072 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4dd4728fea4631b313ae3b5cade579)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:13.544971 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:13.755244 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4dd4728fea4631b313ae3b5cade579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:13.761824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4dd4728fea4631b313ae3b5cade579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:13.821354 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4dd4728fea4631b313ae3b5cade579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:13.832987 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4dd4728fea4631b313ae3b5cade579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:13.833612 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4dd4728fea4631b313ae3b5cade579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:13.839373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1402/2817] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:13 2022] DELETE /identity/v3/users/4a4dd4728fea4631b313ae3b5cade579 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:13.844105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:13.844579 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:13.844718 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:13.861256 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:13.863004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:13.918812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1416/2818] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:13.928990 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:13.930402 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:13.986359 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5652-2986-4d92-b6d7-61e28e5b4414 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:13.990427 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:13.991065 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:13.991347 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:13.991619 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.000506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:14.001964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:14.011803 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1403/2819] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:14.158435 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:14.160452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:14.217961 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d92e0b-1280-4968-975d-4a8d071ffc0c None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:14.222218 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:14.222862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.223139 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.223408 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.225193 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:14.286594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:14.288053 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636fb55-8a38-43bd-a439-aa18a9135578 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:14.297514 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1417/2820] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:14.408199 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:14.410203 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:14.424381 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd7a1-7f6c-439e-a76d-0fbf960f7f15 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:14.429494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:14.431131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.431487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.436364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] PATH_INFO: `/v3/projects/8121c3f938fb46cd989acc7e8fc8c6fd` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.436364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8121c3f938fb46cd989acc7e8fc8c6fd)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:14.436364 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:14.550408 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8121c3f938fb46cd989acc7e8fc8c6fd', 'request_id': 'req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:14.555626 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8121c3f938fb46cd989acc7e8fc8c6fd', 'request_id': 'req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:14.638745 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8121c3f938fb46cd989acc7e8fc8c6fd', 'request_id': 'req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:14.650487 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] The token cache is being invalidate because project 8121c3f938fb46cd989acc7e8fc8c6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:14.650765 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:14.651373 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-f4c8bdbd-6df3-42f0-b2d3-f32dae233579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:14.653140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1404/2821] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:14 2022] DELETE /identity/v3/projects/8121c3f938fb46cd989acc7e8fc8c6fd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:14.657794 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.659764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.659764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.676653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:14.677963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:14.735182 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1418/2822] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:14.743156 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.743447 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.744186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.762755 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:14.763919 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:14.772663 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1405/2823] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:14.777095 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:14.787325 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200add4-c618-46ad-9091-cd5d1f1210db None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:14.791931 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:14.793215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.793215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.793215 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.793853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:40:14.794159 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:14.795770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:14.807090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1419/2824] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:40:14.811306 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:14.820507 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6651c0-7e2c-45c5-9596-abd7f0215039 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:14.825116 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:14.825780 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:14.826063 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:14.826362 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:14.827041 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:14.828931 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:14.976001 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1406/2825] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:40:14 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:40:14.978750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:14.989001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65acfb-399c-4478-9300-96b1070e841a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:15.045861 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:15.046527 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.046805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.047075 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.047789 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:15.049725 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:15.207813 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1420/2826] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:40:14 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 25 03:40:15.211818 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:15.221948 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f0d1-add5-483c-a59f-5202d7cf0d03 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:15.226405 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:15.227043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.227328 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.227605 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.228313 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:15.229943 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:15.247083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1407/2827] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:15.249817 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:15.260532 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196bd-6c6b-45a9-9a04-e83e7bbca513 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:15.265087 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:15.265771 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.266054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.266324 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.267029 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:15.268636 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af2086-38b0-4a19-8877-e403f64f30c4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:15.278308 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1421/2828] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:40:15.284078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:15.293762 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fda8d0-fe9c-436c-ba48-c932cdd34d06 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:15.298171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:15.299027 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.299301 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.300075 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] PATH_INFO: `/v3/projects/59290775e12148eba765bb5cfa828a4a/users/271dc5902ee64bb0a2bb29a7152ecf71/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.314083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59290775e12148eba765bb5cfa828a4a, user_id=271dc5902ee64bb0a2bb29a7152ecf71, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:15.317483 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:15.457771 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1408/2829] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:15 2022] PUT /identity/v3/projects/59290775e12148eba765bb5cfa828a4a/users/271dc5902ee64bb0a2bb29a7152ecf71/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 25 03:40:15.469275 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.469505 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.469821 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.495988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] MFA Rules not processed for user `271dc5902ee64bb0a2bb29a7152ecf71`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:15.497217 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:15.559499 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1422/2830] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:15.570951 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:15.572613 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:15.629486 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc995e-29a7-449c-bdf2-5ca7f1d77f85 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:15.633078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:15.633743 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:15.634029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:15.634304 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:15.642602 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:15.644058 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb5ba-1a5d-4d89-8c85-d7400003a6c3 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:15.652852 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1409/2831] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:22.259919 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:22.261338 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:22.323425 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7d4c-2d7d-4eb9-b82f-64ca97eda0a0 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:22.327808 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:22.328650 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:22.328926 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:22.329194 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] PATH_INFO: `/v3/users/f564d6e4a7764dd794fb209e5ea129d7` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:22.330361 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f564d6e4a7764dd794fb209e5ea129d7)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:22.332761 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:22.514716 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f564d6e4a7764dd794fb209e5ea129d7'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:22.522001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f564d6e4a7764dd794fb209e5ea129d7'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:22.533107 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f564d6e4a7764dd794fb209e5ea129d7'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:22.533988 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f564d6e4a7764dd794fb209e5ea129d7'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:22.603909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f564d6e4a7764dd794fb209e5ea129d7'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:22.610441 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1423/2832] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:22 2022] DELETE /identity/v3/users/f564d6e4a7764dd794fb209e5ea129d7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:22.619539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:22.619539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:22.619539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:22.632555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:22.633864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:22.691983 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1410/2833] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:22.703115 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:22.704515 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:22.773653 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f674-052b-480a-95f2-f594802caf8b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:22.778403 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:22.779156 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:22.779655 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:22.780058 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:22.790061 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:22.791522 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:22.801777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1424/2834] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:23.217078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:23.219005 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:23.232615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f006-df11-4e6b-b492-a67e90a017dc None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:23.238104 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:23.238972 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:23.239254 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:23.239531 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] PATH_INFO: `/v3/projects/c38e0f0920cd4815bde061a866d48749` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:23.240773 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38e0f0920cd4815bde061a866d48749)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:23.242658 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:23.358226 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38e0f0920cd4815bde061a866d48749', 'request_id': 'req-458f139b-4193-425b-8478-06237f824f24'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.364153 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38e0f0920cd4815bde061a866d48749', 'request_id': 'req-458f139b-4193-425b-8478-06237f824f24'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.432844 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38e0f0920cd4815bde061a866d48749', 'request_id': 'req-458f139b-4193-425b-8478-06237f824f24'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.444020 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] The token cache is being invalidate because project c38e0f0920cd4815bde061a866d48749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:23.444298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.444904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.446454 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1411/2835] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:23 2022] DELETE /identity/v3/projects/c38e0f0920cd4815bde061a866d48749 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:23.450407 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:23.460021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c567-9f55-4585-b5a2-7529f8271a7e service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:23.514685 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:23.515540 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:23.515822 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:23.516097 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] PATH_INFO: `/v3/users/38ea5e83e8934d1a98d299e4814c5c4e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:23.517262 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ea5e83e8934d1a98d299e4814c5c4e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:23.519749 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:23.687967 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ea5e83e8934d1a98d299e4814c5c4e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.694577 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ea5e83e8934d1a98d299e4814c5c4e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.706328 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ea5e83e8934d1a98d299e4814c5c4e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.706987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ea5e83e8934d1a98d299e4814c5c4e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.817557 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3426b8c1-be0b-40b8-84cb-ff43708c24e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ea5e83e8934d1a98d299e4814c5c4e'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:23.823965 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1425/2836] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:23 2022] DELETE /identity/v3/users/38ea5e83e8934d1a98d299e4814c5c4e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:24.242488 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:24.243966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:24.257777 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f139b-4193-425b-8478-06237f824f24 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:24.314553 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:24.316139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.316418 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.316688 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] PATH_INFO: `/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.317900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d9eb13b7704d7a9edb85fce56d064c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:24.319875 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:24.451466 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d9eb13b7704d7a9edb85fce56d064c', 'request_id': 'req-2590ceef-7c44-464b-8792-016d5797562a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:24.457174 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d9eb13b7704d7a9edb85fce56d064c', 'request_id': 'req-2590ceef-7c44-464b-8792-016d5797562a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:24.531964 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d9eb13b7704d7a9edb85fce56d064c', 'request_id': 'req-2590ceef-7c44-464b-8792-016d5797562a'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:24.542819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] The token cache is being invalidate because project b9d9eb13b7704d7a9edb85fce56d064c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:24.543107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:24.543746 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-2590ceef-7c44-464b-8792-016d5797562a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:24.545249 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1412/2837] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:24 2022] DELETE /identity/v3/projects/b9d9eb13b7704d7a9edb85fce56d064c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:24.551951 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.552413 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.552512 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.570534 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:24.571713 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:24.628847 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1426/2838] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:24.637034 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.637321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.637595 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.656278 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:24.657453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:24.665502 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1413/2839] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:24.669350 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:24.679155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da213-da04-4fb3-8d25-e6ca3b8f590e None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:24.683582 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:24.684203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.684480 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.684745 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.685448 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:40:24.685780 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:24.687371 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:24.699036 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1427/2840] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:40:24.703205 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:24.712554 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d126-9ac5-4b34-b1a6-ad2cf23ef4b7 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:24.717059 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:24.717977 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.718257 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.718527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.719186 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:24.721216 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:24.799321 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1414/2841] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:40:24 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:24.803434 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:24.813141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568383e-d8a5-48f0-8751-cb2e496628a8 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:24.867216 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:24.867878 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.868162 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.868437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.869110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:24.871073 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:24.967555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1428/2842] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:40:24 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:24.973788 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:24.982994 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2424-a6ee-49b4-8a93-7db51a177a2a admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:24.988171 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:24.988824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:24.989107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:24.989380 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:24.990134 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:24.991735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.003277 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1415/2843] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:40:25.007141 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:25.017531 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c55e9-fe77-44cf-9d75-db06930c7fbe admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:25.022569 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:25.023223 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.023529 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.023862 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.024575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:25.026312 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32686-06cd-4934-84ef-1d022d0ba72c admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.038205 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1429/2844] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:25.042668 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:25.054166 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58933-79f9-4653-a006-db2a57fed87d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:25.061085 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:25.062119 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.062924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.063317 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] PATH_INFO: `/v3/projects/41da10e94f204a309128c96775c37ca3/users/a8093af91acc4b08a7e73489d3c7d14c/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.081615 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41da10e94f204a309128c96775c37ca3, user_id=a8093af91acc4b08a7e73489d3c7d14c, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:25.089708 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.161009 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1416/2845] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:25 2022] PUT /identity/v3/projects/41da10e94f204a309128c96775c37ca3/users/a8093af91acc4b08a7e73489d3c7d14c/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:25.173545 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.173866 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.174696 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.207884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] MFA Rules not processed for user `a8093af91acc4b08a7e73489d3c7d14c`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:25.209155 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:25.273820 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1430/2846] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:25.284864 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:25.286735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:25.341491 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393492d3-4200-4be8-a54e-9d369d5a0f73 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:25.345422 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:25.346569 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.346848 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.347118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.355106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:25.356525 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a643-2ee8-48f5-8197-14e51e873fa0 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.365559 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1417/2847] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:25.383537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:25.442943 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fa1fa-21cb-448a-b176-1f7e22cc5fca None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:25.447654 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:25.448489 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.448767 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.449039 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] PATH_INFO: `/v3/users/a8093af91acc4b08a7e73489d3c7d14c` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.450263 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8093af91acc4b08a7e73489d3c7d14c)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:25.452209 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.660069 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8093af91acc4b08a7e73489d3c7d14c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:25.666687 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8093af91acc4b08a7e73489d3c7d14c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:25.678751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8093af91acc4b08a7e73489d3c7d14c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:25.679418 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8093af91acc4b08a7e73489d3c7d14c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:25.755040 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8093af91acc4b08a7e73489d3c7d14c'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:25.760992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1431/2848] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:25 2022] DELETE /identity/v3/users/a8093af91acc4b08a7e73489d3c7d14c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:25.767735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.767735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.767735 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.782527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:25.783712 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:25.839100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1418/2849] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:25.848792 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:25.850240 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:25.906105 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28466-847a-40cf-83f2-7e6a96bcdd5d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:25.909699 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:25.910380 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:25.910613 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:25.910885 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:25.919608 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:25.921032 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b318de-f885-452d-8ed6-4249a87cb452 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:25.930876 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1432/2850] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:26.390546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:26.404524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:26.404524 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331147b2-2643-4b31-9da6-581bf60732e2 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:26.408385 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:26.409800 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:26.410078 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:26.410371 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] PATH_INFO: `/v3/projects/41da10e94f204a309128c96775c37ca3` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:26.411669 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41da10e94f204a309128c96775c37ca3)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:26.413544 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:26.513944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41da10e94f204a309128c96775c37ca3', 'request_id': 'req-4ed1d53d-25f9-4009-a869-713ea53b2d05'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:26.519732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41da10e94f204a309128c96775c37ca3', 'request_id': 'req-4ed1d53d-25f9-4009-a869-713ea53b2d05'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:26.612597 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41da10e94f204a309128c96775c37ca3', 'request_id': 'req-4ed1d53d-25f9-4009-a869-713ea53b2d05'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:26.623949 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] The token cache is being invalidate because project 41da10e94f204a309128c96775c37ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:26.624232 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:26.624865 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-4ed1d53d-25f9-4009-a869-713ea53b2d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:26.626437 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1419/2851] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:26 2022] DELETE /identity/v3/projects/41da10e94f204a309128c96775c37ca3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:26.631319 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:26.631607 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:26.631907 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:26.649445 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:26.650677 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:26.706618 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1433/2852] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:26.714808 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:26.715099 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:26.715372 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:26.734118 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:26.735345 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:26.743188 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1420/2853] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:26.747493 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:26.757125 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b6ac-3879-4f64-8bed-ccd70b4c0fec None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:26.761787 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:26.762431 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:26.762710 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:26.765462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] PATH_INFO: `/v3/domains` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:26.765462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 25 03:40:26.765462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:26.765812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:26.777284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1434/2854] 10.222.0.24 () {58 vars in 1152 bytes} [Fri Mar 25 03:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 25 03:40:26.781586 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:26.791258 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95694d3-4d0c-4686-806b-f3f7a1a74b78 None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:26.795910 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:26.796539 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:26.796815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:26.797083 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:26.797797 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:26.799685 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:26.943890 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1421/2855] 10.222.0.24 () {60 vars in 1152 bytes} [Fri Mar 25 03:40:26 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:26.948096 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:26.965707 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7c039-37d0-4adb-92de-a44f786c657b admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.037010 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.037701 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.037981 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.038253 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] PATH_INFO: `/v3/users` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.038932 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.040836 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.150288 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1435/2856] 10.222.0.24 () {60 vars in 1143 bytes} [Fri Mar 25 03:40:26 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 25 03:40:27.154282 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:27.164105 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd139-ed89-4999-85ce-b958973871a0 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.168552 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.169189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.169467 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.169769 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.170494 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.172312 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.183407 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1422/2857] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 25 03:40:27.191375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:27.202055 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01015816-606f-43ed-8bf9-c7436f027e2a admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.206559 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.207203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.207482 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.215399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] PATH_INFO: `/v3/roles` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.215399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.215399 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94728c9-bec3-4d7c-a25d-75ac4d26303d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.220144 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1436/2858] 10.222.0.24 () {58 vars in 1121 bytes} [Fri Mar 25 03:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 25 03:40:27.224245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:27.233955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929d679-621b-4307-b9fc-3db78acadc03 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.238440 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.239819 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.240100 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.240374 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] PATH_INFO: `/v3/projects/17c3acf64f4c4ec98e7a0d5d73878b74/users/754df418e86c45d1a1113a6e21c0c37b/roles/6c92be9ce56e4845a791f4b0886eb2c0` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.254183 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3acf64f4c4ec98e7a0d5d73878b74, user_id=754df418e86c45d1a1113a6e21c0c37b, role_id=6c92be9ce56e4845a791f4b0886eb2c0)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.257485 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.355182 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1423/2859] 10.222.0.24 () {60 vars in 1482 bytes} [Fri Mar 25 03:40:27 2022] PUT /identity/v3/projects/17c3acf64f4c4ec98e7a0d5d73878b74/users/754df418e86c45d1a1113a6e21c0c37b/roles/6c92be9ce56e4845a791f4b0886eb2c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:27.365884 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] REQUEST_METHOD: `POST` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.366180 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.366452 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.393301 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.auth.core [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] MFA Rules not processed for user `754df418e86c45d1a1113a6e21c0c37b`. Rule list: `[]` (Enabled: `True`). {{(pid=79920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:27.394593 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:27.487419 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1437/2860] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:27.497908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:27.498580 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:27.557883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b387-53ca-44da-a11e-8e7f62e4af68 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.561783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.562640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.562944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.563237 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.571924 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.573396 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b73c2c-54a9-44b5-a01f-01236a071565 service cinder] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.582228 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1424/2861] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:40:27.607917 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:27.667832 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17431c05-51ee-4163-a98a-278b2c5c1ad8 None None] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:27.672310 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:27.673161 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.673442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.673750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] PATH_INFO: `/v3/users/754df418e86c45d1a1113a6e21c0c37b` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:27.674929 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754df418e86c45d1a1113a6e21c0c37b)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:27.677498 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:27.868804 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754df418e86c45d1a1113a6e21c0c37b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:27.875358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754df418e86c45d1a1113a6e21c0c37b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:27.886598 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754df418e86c45d1a1113a6e21c0c37b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:27.887268 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754df418e86c45d1a1113a6e21c0c37b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:27.975750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754df418e86c45d1a1113a6e21c0c37b'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:27.982014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1438/2862] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:27 2022] DELETE /identity/v3/users/754df418e86c45d1a1113a6e21c0c37b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:27.986530 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:27.986824 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:27.987106 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:28.003686 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:28.004981 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:28.060566 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1425/2863] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:28.070013 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:28.071367 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:28.127001 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08de-fdaf-41cb-a972-6066ec85d411 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:28.130566 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:28.131195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:28.131476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:28.131743 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:28.140313 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:28.141775 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:28.151353 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1439/2864] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:28.543235 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:28.544655 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:28.558178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfafe5-e492-44a8-a615-c14ceaa4561f None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:28.562958 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:28.563827 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:28.564107 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:28.564377 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] PATH_INFO: `/v3/projects/17c3acf64f4c4ec98e7a0d5d73878b74` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:28.565548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c3acf64f4c4ec98e7a0d5d73878b74)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:28.567541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:28.678571 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c3acf64f4c4ec98e7a0d5d73878b74', 'request_id': 'req-3b33638a-aee1-4cff-b2d8-b164f67e98e4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:28.684055 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c3acf64f4c4ec98e7a0d5d73878b74', 'request_id': 'req-3b33638a-aee1-4cff-b2d8-b164f67e98e4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:28.766409 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c3acf64f4c4ec98e7a0d5d73878b74', 'request_id': 'req-3b33638a-aee1-4cff-b2d8-b164f67e98e4'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:28.778246 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] The token cache is being invalidate because project 17c3acf64f4c4ec98e7a0d5d73878b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:28.778537 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:28.779231 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-3b33638a-aee1-4cff-b2d8-b164f67e98e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:28.780782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1426/2865] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:28 2022] DELETE /identity/v3/projects/17c3acf64f4c4ec98e7a0d5d73878b74 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:37.027396 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:37.028805 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:37.042078 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068220-b14b-4919-878c-037b3184712f service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:37.095462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:37.096322 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:37.096604 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:37.096881 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] PATH_INFO: `/v3/users/271dc5902ee64bb0a2bb29a7152ecf71` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:37.098088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271dc5902ee64bb0a2bb29a7152ecf71)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:37.100021 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:37.296616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271dc5902ee64bb0a2bb29a7152ecf71'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:37.303281 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271dc5902ee64bb0a2bb29a7152ecf71'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:37.314783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271dc5902ee64bb0a2bb29a7152ecf71'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:37.315501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271dc5902ee64bb0a2bb29a7152ecf71'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:37.389088 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271dc5902ee64bb0a2bb29a7152ecf71'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:37.395041 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1440/2866] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:37 2022] DELETE /identity/v3/users/271dc5902ee64bb0a2bb29a7152ecf71 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:37.400007 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:37.400468 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:37.400581 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:37.418496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] MFA Rules not processed for user `e9bcc766764e43018f6a81968bc39446`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:40:37.419704 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:37.474947 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1427/2867] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:40:37.484462 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:37.485889 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:37.540916 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2fb75-2663-4c14-af5a-36da1ae00c75 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:37.544565 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:37.545195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:37.545476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:37.545782 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:37.554588 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:37.555987 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:37.565187 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1441/2868] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:40:37.965900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:37.967189 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:37.981413 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f32d5-5490-4f39-9144-74ee57fbdd4a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:37.986161 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:37.987016 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:37.987298 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:37.987573 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] PATH_INFO: `/v3/projects/59290775e12148eba765bb5cfa828a4a` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:37.988883 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] RBAC: Authorizing `identity:delete_project(project_id=59290775e12148eba765bb5cfa828a4a)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:37.990867 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:38.087840 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59290775e12148eba765bb5cfa828a4a', 'request_id': 'req-231cefb1-89c9-4e3a-9098-358cb0b6936f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:38.093131 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59290775e12148eba765bb5cfa828a4a', 'request_id': 'req-231cefb1-89c9-4e3a-9098-358cb0b6936f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:38.160489 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59290775e12148eba765bb5cfa828a4a', 'request_id': 'req-231cefb1-89c9-4e3a-9098-358cb0b6936f'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:38.171904 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] The token cache is being invalidate because project 59290775e12148eba765bb5cfa828a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:38.172187 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:38.172817 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:38.174403 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1428/2869] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:37 2022] DELETE /identity/v3/projects/59290775e12148eba765bb5cfa828a4a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:51.044744 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:51.053630 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380aae-abd3-4ebd-be6a-3023168eb29d service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:51.100414 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:51.101074 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:51.101368 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:51.101622 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:51.103394 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:51.165760 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:51.167110 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:51.176624 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1442/2870] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:40:58.328355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:58.330555 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:58.343930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cefb1-89c9-4e3a-9098-358cb0b6936f admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:58.348435 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:58.353575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:58.353575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:58.353575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] PATH_INFO: `/v3/users/dbfc5ac653fa4809a732bdef3b43a8be` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:58.353575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfc5ac653fa4809a732bdef3b43a8be)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:58.353575 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:58.530197 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfc5ac653fa4809a732bdef3b43a8be'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:58.536578 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfc5ac653fa4809a732bdef3b43a8be'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:58.614652 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfc5ac653fa4809a732bdef3b43a8be'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:58.626517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfc5ac653fa4809a732bdef3b43a8be'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:58.627168 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfc5ac653fa4809a732bdef3b43a8be'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:58.633026 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1429/2871] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:58 2022] DELETE /identity/v3/users/dbfc5ac653fa4809a732bdef3b43a8be => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:58.850770 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:58.861742 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7970d-43cf-4b8e-9de1-e1c056b10356 service neutron] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:58.915501 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:58.916358 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:58.916638 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:58.916910 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] PATH_INFO: `/v3/projects/48056ec4a0a14de9bc3675f24e816164` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:58.918142 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48056ec4a0a14de9bc3675f24e816164)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:58.920054 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:59.002835 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48056ec4a0a14de9bc3675f24e816164', 'request_id': 'req-a63d7e2e-5339-40c7-9b82-c027e090d99d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.008134 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48056ec4a0a14de9bc3675f24e816164', 'request_id': 'req-a63d7e2e-5339-40c7-9b82-c027e090d99d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.014678 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48056ec4a0a14de9bc3675f24e816164', 'request_id': 'req-a63d7e2e-5339-40c7-9b82-c027e090d99d'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.077120 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] The token cache is being invalidate because project 48056ec4a0a14de9bc3675f24e816164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:59.077402 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.078023 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.079537 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1443/2872] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:58 2022] DELETE /identity/v3/projects/48056ec4a0a14de9bc3675f24e816164 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:59.083459 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:59.084845 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:59.098501 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dff48-2ff0-4cd0-85c6-74bd9dffd7e3 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:59.151541 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:59.152388 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:59.152667 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:59.152938 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] PATH_INFO: `/v3/users/fc016a84e19c4e8eba776239372fc198` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:59.154130 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc016a84e19c4e8eba776239372fc198)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:59.156017 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:59.304355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc016a84e19c4e8eba776239372fc198'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.311451 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc016a84e19c4e8eba776239372fc198'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.377774 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc016a84e19c4e8eba776239372fc198'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.390070 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc016a84e19c4e8eba776239372fc198'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.390795 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc016a84e19c4e8eba776239372fc198'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.396930 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1430/2873] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:40:59 2022] DELETE /identity/v3/users/fc016a84e19c4e8eba776239372fc198 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:40:59.647574 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:40:59.649014 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:40:59.662272 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7e2e-5339-40c7-9b82-c027e090d99d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:40:59.716693 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:40:59.717539 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:40:59.718169 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:40:59.718444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] PATH_INFO: `/v3/projects/c35f84afe6364992963940ca78607d2e` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:40:59.719620 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35f84afe6364992963940ca78607d2e)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:40:59.721533 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:40:59.828236 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35f84afe6364992963940ca78607d2e', 'request_id': 'req-7475369b-caf8-4e2d-8900-41857954fcae'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.833463 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35f84afe6364992963940ca78607d2e', 'request_id': 'req-7475369b-caf8-4e2d-8900-41857954fcae'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.839555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35f84afe6364992963940ca78607d2e', 'request_id': 'req-7475369b-caf8-4e2d-8900-41857954fcae'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.904812 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] The token cache is being invalidate because project c35f84afe6364992963940ca78607d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:40:59.905392 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.905632 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:40:59.907172 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1444/2874] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:40:59 2022] DELETE /identity/v3/projects/c35f84afe6364992963940ca78607d2e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:42:05.195436 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:05.196855 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:05.252091 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759986-e73f-43a9-8bff-761efdaa5588 admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:05.298847 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:05.299480 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:05.299757 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:05.300023 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:05.301781 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:05.310701 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:05.312113 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1535-2ec4-4124-a80d-d41f0ee3275c service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:05.320406 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1431/2875] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:13.220508 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:13.221909 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:13.277195 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475369b-caf8-4e2d-8900-41857954fcae admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:13.280751 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:13.281386 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:13.281684 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:13.281966 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:13.283700 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:13.339721 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:13.341228 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:13.351348 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1445/2876] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:22.804966 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] REQUEST_METHOD: `POST` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:22.805517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:22.805517 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:22.822367 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.auth.core [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] MFA Rules not processed for user `384b83917c9a4766b0117de6e71942ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 25 03:42:22.823556 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:22.830767 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1432/2877] 10.222.0.24 () {58 vars in 957 bytes} [Fri Mar 25 03:42:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 25 03:42:22.866318 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:22.874777 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a5a-1eda-40ac-ae1f-f0cab8b7e71e service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:22.878370 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556b5d7a961746acb131a732b62940e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:22.879004 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:22.879284 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:22.879555 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:22.881297 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:22.949581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:22.950992 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:22.963063 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1446/2878] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:23.243866 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:23.245222 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:23.257178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9e46c-2927-4a38-8a1b-0fba4930126a None None] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:23.260629 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:23.261253 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:23.261527 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:23.261842 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:23.263521 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:23.273053 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:23.274572 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:23.282265 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1433/2879] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:25.223278 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:25.224643 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:25.229610 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:25.231043 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:25.241635 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16d1b-f179-47d3-96fa-3b86307ac730 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:25.245245 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:25.245900 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:25.246178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:25.246445 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:25.248140 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:25.262516 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:25.263974 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:25.274707 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1434/2880] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 25 03:42:25.294261 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef784-bb8e-4fa2-aa38-50db5cafd217 service cinder] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:25.299697 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:25.300476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:25.300764 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:25.301037 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:25.302825 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:25.315616 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:25.317213 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:25.327178 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1447/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:28.997815 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:29.000548 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:29.015039 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e345-33bf-4f30-96d2-7535c86205ff service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:29.022139 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:29.022783 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:29.023062 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:29.023335 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:29.025094 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:29.038726 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:29.042233 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:29.051944 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1435/2882] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:39.600963 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:39.614019 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fff4f-6298-491d-ad27-7469ff839a49 service placement] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:39.619436 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:39.624853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:39.624853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:39.624853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:39.624853 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:39.634575 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:39.636151 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:39.646752 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1448/2883] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:42:43.609496 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:42:43.621512 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cde9b6-e98b-4588-936a-97f87da33f97 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:42:43.627190 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba728b1294014f94b7acab7ccf594ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:42:43.627831 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:42:43.628690 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:42:43.628969 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:42:43.631290 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:42:43.643628 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:42:43.645202 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:42:43.656056 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1436/2884] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:42:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:44:14.435554 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:14.437395 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:14.522658 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca4b1-381d-429b-af3c-add9d10a118f service nova] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:14.527799 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:14.528444 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:14.528729 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:14.529005 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:14.530870 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:14.542948 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:14.544546 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:14.554978 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1449/2885] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:44:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:44:28.368438 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:28.404449 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce98a-51a1-40d2-bc86-047003a6c631 service nova] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:28.408015 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d4c142d5db423b868edceab8bdd019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:28.408640 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] REQUEST_METHOD: `GET` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:28.408921 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:28.409195 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:28.410955 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:28.489439 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:28.490825 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:28.509497 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1437/2886] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 25 03:44:36.015437 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:36.016332 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:36.030089 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba66b8-e623-4af3-8ab9-fd56ddebed47 service placement] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:36.034583 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:36.035442 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:36.038411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:36.038411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] PATH_INFO: `/v3/users/384b83917c9a4766b0117de6e71942ba` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:36.038411 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384b83917c9a4766b0117de6e71942ba)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:36.039203 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:36.222705 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384b83917c9a4766b0117de6e71942ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.229510 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384b83917c9a4766b0117de6e71942ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.241474 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384b83917c9a4766b0117de6e71942ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.242170 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384b83917c9a4766b0117de6e71942ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.341673 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384b83917c9a4766b0117de6e71942ba'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.348137 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1450/2887] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:44:36 2022] DELETE /identity/v3/users/384b83917c9a4766b0117de6e71942ba => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:44:36.615782 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:36.630013 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fd02-20ac-449a-bcf9-345c90a9a601 service neutron] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:36.685616 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:36.686482 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:36.686760 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:36.687029 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] PATH_INFO: `/v3/projects/128b813a50464f31b257ffac581ed332` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:36.688180 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] RBAC: Authorizing `identity:delete_project(project_id=128b813a50464f31b257ffac581ed332)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:36.690121 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:36.826644 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128b813a50464f31b257ffac581ed332', 'request_id': 'req-85eb2dd6-b327-427b-ba92-df1008a8748d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.832297 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128b813a50464f31b257ffac581ed332', 'request_id': 'req-85eb2dd6-b327-427b-ba92-df1008a8748d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.913142 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128b813a50464f31b257ffac581ed332', 'request_id': 'req-85eb2dd6-b327-427b-ba92-df1008a8748d'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.924770 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] The token cache is being invalidate because project 128b813a50464f31b257ffac581ed332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:44:36.925047 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.929178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:36.929178 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1438/2888] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:44:36 2022] DELETE /identity/v3/projects/128b813a50464f31b257ffac581ed332 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:44:36.931329 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:36.932750 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:36.946154 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7622-c507-43de-955c-ac2fb8e439a4 admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:37.009553 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:37.010492 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:37.010773 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:37.011098 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] PATH_INFO: `/v3/users/442132987dad4db6a4cec799598c0ad8` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:37.012868 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=442132987dad4db6a4cec799598c0ad8)` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:37.014982 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:37.160026 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442132987dad4db6a4cec799598c0ad8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.166581 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442132987dad4db6a4cec799598c0ad8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.177544 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442132987dad4db6a4cec799598c0ad8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.178230 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442132987dad4db6a4cec799598c0ad8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.238476 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.notifications [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442132987dad4db6a4cec799598c0ad8'} {{(pid=79920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.244594 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1451/2889] 10.222.0.24 () {58 vars in 1223 bytes} [Fri Mar 25 03:44:36 2022] DELETE /identity/v3/users/442132987dad4db6a4cec799598c0ad8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:44:37.489988 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Authenticating user token {{(pid=79919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:44:37.491546 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.fernet_utils [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:44:37.504506 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2dd6-b327-427b-ba92-df1008a8748d admin admin] Validating token access rules against request {{(pid=79919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:44:37.559611 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bcc766764e43018f6a81968bc39446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1302222fc7241c1bba468ff84d0f185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:44:37.560453 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:44:37.560732 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:44:37.561004 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] PATH_INFO: `/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c` {{(pid=79919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:44:37.562275 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fb69e82e1f4eb5a5fca454ca905b0c)` {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:44:37.564172 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] RBAC: Authorization granted {{(pid=79919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:44:37.682681 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fb69e82e1f4eb5a5fca454ca905b0c', 'request_id': 'req-797f38f6-da38-4bee-a670-bd3890eb4d01'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.687836 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fb69e82e1f4eb5a5fca454ca905b0c', 'request_id': 'req-797f38f6-da38-4bee-a670-bd3890eb4d01'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.768124 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fb69e82e1f4eb5a5fca454ca905b0c', 'request_id': 'req-797f38f6-da38-4bee-a670-bd3890eb4d01'} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.779355 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] The token cache is being invalidate because project 64fb69e82e1f4eb5a5fca454ca905b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 25 03:44:37.779632 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.780384 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: DEBUG keystone.notifications [None req-797f38f6-da38-4bee-a670-bd3890eb4d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 25 03:44:37.781908 dv-cinder-835168-1-iscsi devstack@keystone.service[79919]: [pid: 79919|app: 0|req: 1439/2890] 10.222.0.24 () {58 vars in 1232 bytes} [Fri Mar 25 03:44:37 2022] DELETE /identity/v3/projects/64fb69e82e1f4eb5a5fca454ca905b0c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 25 03:49:19.400900 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Authenticating user token {{(pid=79920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 25 03:49:19.402397 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:49:19.468679 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659662e3-c036-41c4-b8aa-1a8c0df0b44d admin admin] Validating token access rules against request {{(pid=79920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 25 03:49:19.524800 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9285da9a24b19afb6038cd95122a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3df45ec7150f4e2990b00240f7fce2a2', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 25 03:49:19.525364 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] REQUEST_METHOD: `GET` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 25 03:49:19.525641 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] SCRIPT_NAME: `/identity` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 25 03:49:19.525944 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 25 03:49:19.527690 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.fernet_utils [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 25 03:49:19.538783 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 25 03:49:19.540375 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a9b4-3c10-422b-b891-cc8ee80f4a81 service placement] RBAC: Authorization granted {{(pid=79920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 25 03:49:19.550090 dv-cinder-835168-1-iscsi devstack@keystone.service[79920]: [pid: 79920|app: 0|req: 1452/2891] 10.222.0.24 () {60 vars in 1365 bytes} [Fri Mar 25 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)